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PREFACE 

This issue of the JOURNAL is a counterpart issue to Volume 2 , Number 1 
published in October I966. Both are devoted to an evaluation of the impact 
of the Elementary and Secondary Education Act on the Cincinnati Public Schools* 
This issue assesses the impact after one and one-half years of ESEA services 
while the former assessed only the first half year of operation. With fey 
modifications the program was the same for both years. 

While this report concerns Cincinnati’s program, it should be viewed as 
one effort, along with thousands of others across the country, at attempting 
to assess the impact of ESEA, Title I on disadvantaged children. Nationally, 
we are working toward breaking the poverty cycle. Title I of ESEA is a major 
thrust in attacking this problem through its educational facet. All the 
evidence and knowledge must be taken together and seen as a total picture 
rather thsui viewed on an individual school district basis. To this end, this 
issue is being distributed nationally and it is hoped that results from other 
school districts will be shared with Cincinnati. We encourage constructive 
criticism and dialogue with other evaluators who are working on this problem. 

In preparing this report, the authors have worked under great time 
pressure. We felt the significant findings must be made available to the 
staff by the beginning of the I967-68 school year in order to be of value. 

Yet, the two summer months available to do this job have been insufficient to 
prepare a comprehensive report on all details. We have foregone the reporting 
of most of the statistical analyses but for the average reader this is no great 
loss. 

The evaluation of the Education Act is the responsibility of the Division 
of Program Development, James N. Jacobs, Director and Joseph L. Felix, Associate. 
They are the authors of this report and consequently any communications regarding 
its content should be directed to them. The total report represents a team 








effort from several divisions. Marius P. Garofalo, Director )f Educational 
Opportunity Services, who serves as the administrator of the ESEA. program 
and his staff, have worked diligently in data collection, pupil identifi- 
cation, and in many other ways with the evaluators. The Division of 
Psychological Services, Charles Miller, Director, gave valuable assistance 
in the administration and scoring of the self-concept measures. The Division 
of Evaluation Services, Joan Bolienbacher, Director, was responsible for the 



distribution and scoring of standardized achievement tests, and the various 
survey measures. Suzanne Hetzel deserves special recognition for the latter 
effort. Finally, the Division of Data Processing, Edward Ebel, Director and 
Walter Reece, Educational Coordinator, spent many hours on designing programs 
for scoring and data analysis. 

This report is concerned with the general effects of the Education Act 
program which consists of six separate projects: Early Childhood Education; 

Physical Health Services; Snotional, Learning and Communication Problems; Staff 
Development, Leadership and In-Service Training; Elementary School Reniediation 
and Enrichment; and Secondary School Remediation and Enrichment. Because of 
the nature of this program evaluation, the Early Childhood Education project 
probably had little effect on results since these children were mainly first 
graders in 1966 - 6 ?* Specific evaluation of all six projects including Early 
Childhood Education will be reported in the next issue of this JOURNAL. 



Robert P. Curry 
Associate Superintendent 
Department of Instruction 
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CHAPTER 1 
INTRODUCTION 

Background 

This report is an extension of the program evaluation of the Education 
Act which was initiated in Cincinnati in January, I966 with the expenditure 
of approximately three million dollars for thirteen separate projects. While 
the thirteen projects operated in 1966 have been combined into six projects 
for 1966-67 and while the funds available were reduced from $3*1 million in 
1966 to $2.9 million in I966-67, the evaluation of the Education Act programs 
is ‘Viewed as a continuous effort. Evaluation reports for the 1966 program 
are described in detail in the Journal of Instructional Research and Program 
Development , Volume 2, Numbers 1, 2, and 3* This report continues the 
evaluation strategies begun last year and introduces an additional strategy. 
The data for the current year will be compared to the baseline data collected 
last year in an effort to measure change or growth. 

We continue to distinguish between program and project evaluation. 

This report is concerned exclusively with program evaluation which is defined 
as the impact of all Education Act ser-vices or projects on the target pupils 
and target schools. Project evaluation, in contrast, deals with outcomes 
particular to a project or services within a project. Succeeding issues of 
the Journal will deal with project evaluation. 

Project Descriptions 

It is appropriate at the outset to give the reader a thumbnail descrip- 
tion of the projects and their component ser-vices for it is the collective 
impact of these services toward which this report is directed. 

1. ELEMENTARY SCHOOL REMEDXmON AND ENRICHMENT (Budget: $1,746,800) 

a. Remedial instruction 

b. Supportive services from administrative aides, 
resource teachers and (parent) resident aides 

c. Educational reso'irce centers 

d. After-school enrichment program 

e. Saturday morning enrichment program 

f. Instrumental music instruction 

g. Field trips and other sources of cultural 
enrichment 
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h. Parent study-discussion groups 

i. Parent leadership training 

j. Provision of child care 
h. Summer school 

2. SECONDARY SCHOOL REMEDIATION AND ENRICHMENT (Budgets $64O3UO0) 

a. Remedial instruction 

b. Supportive services from acttnini-'>trative aides j 
resource teachers, and para-professional personnel 

c. Welfare services (food, clothing, fees) 
do Attendance services 

6o Guidance and counseling services 
fo Summer school 

g. Service and instruction for parents 

3o EMOTIONAL, LEARNING, AND COMMUNICATION PROBLEMS (Budget: $189, 800) 

a. Self-contained classes for emotionally disturbed 
and perceptually handicapped children 
be Clinical diagnostic teams 

c. Supportive services of social workers and teacher 
aides 

d. Remediation of sub- standard speech patterns of 
children, teachers, and parents 

e. Inservice teacher training 

f. Medical examination and treatment 

g. Summer camping experience 

h. Summer institutional program for neglected and/or 
delinquent youth 

h, PHYSICAL HEAISH SERVICES (Budget: $78,600) 

a. Increased nursing and physician service 

b. Health examination for all pupils in grades 4, 7, and 10 

c. Follow-up medical services for remediable defects 

5. EARLY CHILDHOOD EDUCATION (Budget; $183, 200) 

a» Psychiatric examination and treatment 

b. Increased psychological and pupil adjustment 
services headed by psychiatric social worker 

c. Parent education 

d. Einployment of kindergarten aides 

e<. Establishment of a committee to study and evaluate 
programs for four and five year olds 
f o Curriculum materials for articulation of programs 
for four and five year olds 

60 STAFF DEVELOPMENT, LEADERSHIP, AND INSERVICE TRAINING (Budget: $1^6, 300) 

a* Dissemination of information to ESEA staff 

- Professional library collection 
» Catalog of resources 

“ Target newsletter 

- Clearinghouse 
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b. Inservice training 

- Guided visitations 

- University based library training 

- School staff meetings 

- Para-professional workshops 

c. Coordination of ESEA program components with other 
agencies 

d. Community relations 

Tufexcm i jcivcxxuaoxuxi 

The evaluation described in this report is product evaluation * That is, 
it attempts to describe student, teacher, and school characteristics as they 
exist at the end of the program year. The kinds of activities that take place 
during the school year are described in project narratives which will be 
reported in later issues of the Journal. Description of the problems and the 
steps needed to alleviate these problems we term process evaluation . Basically, 
this report concerns itself with changes in criterion measurements ft:om 1966 
to 1967. Since the large majority of criterion data were obtained in late 
spring, they do not reflect the effects of extensive summer school programs. 

The latter will be reported under project evaluation. Three kinds of 
strategies or perspectives may be involved in making these comparisons, all 
of which ajjn to assess the total impact of the Education Act program. Before 
these strategies are outlined, it is important to define four types of schools. 

Primary Target Schools (PT) . These are thirteen public elementary, four 
public secondary, and three non-public elementary schools which have the 
highest concentrations of disadvantaged children in the Cincinnati school 
district. Further, these are the schools in which the six projects operate 
with the greatest intensity. It i s estimated that 80^ of our Education Act 
resources are directed to this primary target set of schools. 

Secondary Target Schools (ST) . This set of schools consists of nineteen 
public elementary, four public secondary, and ten non-public elementary schools. 
Secondary target schools are those with a smaller concentration of disadvan- 
taged pupils and in which only certain projects operate. The remainder of our 
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resources, approximately 20^, was spent in these schools this past year. 

Control Schools (c) . These consist of three public elementary schools 
and two public secondary schools. They contain even fewer disadvantaged 
children than ?T or ST schools, but represent the closest "match" to the 
target schools with respect to economic deprivation. vJith this definition 
in mind, it is apparent the term "control" school takes on a different 
meaning from the traditional one of the term in experimentation. These 
schools receive no Education Act services . 

Su>> urban Schools (S). These consist of ten public elementary and two 
secondary public schools which rank very high in terms of economic advantage- 
ment. They are schools which serve predominantly middle class children and, 
of course, receive no Education Act services. This set of schools was not 
defined in last year’s evaluation. Criterion measurements of these schools 
were made this year as an outside check on the observations made in the 
target schools. 

The four classifications of Cincinnati schools described above are 
not all-inclusive. There are still other schools which receive no services 
which essentially lie between the control and suburban schools with respect 
to economic and cultural deprivation. The general hypothesis is that 
criterion measurements will respond to the intensity of treatments given 
in the Education Act program. Thus, it is expected that primary target 
schools should show the most desirable status and/or change followed by 
secondary target schools and control schools. 

The basic problem is to assess the impact of the six projects and 
their component services ( program evaluation) upon the target population. 
Three types of impact may be defined. First, there is an impact upon 
specific children in target schools who receive "intensive" service from 
ESEA projects. These pupils are most likely to show performance differences 
due to ESEA. Second, there is a possible impact on the school as a whole . 
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This impact has several bases of rationale. The total school may respond to 
some type of Hawthorne effect due to increased attention; certain projects or 
components serve all children in a school; e.g., the resource centers, admini- 
strative aides, various health services such as nurses or giving innoculations 
to all children; specialized project staff may influence other teachers in 
desirable ways. The probability of detecting target school-wide differences 
is much less than detecting target pupil differences. 

The third type of impact, and the one least likely to occur, is the 
impact on the school system as a whole; i.e., all non- target as well as target 
schools. Here again, one may conceive of Hawthorne effects. Changes in 
administrative organization, the self-fulfilling prophecy and staff inter- 
action on a system-wide level could possibly produce desirable change system- 
wide. Only the first two types of impact are assessed; i.e., changes in 
target pupils and target schools . 

Changes in Target School s . As indicated, our interest in status and 
change focuses on the school group as a unit. We want to know whether FT 
schools as a group reflect more (desirable) change and/or status as compared 
to ST or C schools, buch comparison involves averages based on all pupils 
in the schools. This strategy is shown as follows: 

ST 

Schools 

Elem. N=i 4,438 
Sec. N= 4,466 

t 

Compare 1966 and 19^7 

If ESEA services given have a school-wide effect, this type of comparison 
should reflect such change with the expectation being PT ST C. This type of 
comparison is least sensitive to change becaixse the intensity of treatments per 
child is small. 

Changes in Target Pupils . In employing this strategy it is recognized 
that program services are not administered uniformly among all children in 
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Schools 
Elem. N=1967 
Sec. H=1981 
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Schools 
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a target school. Specific children within a target school were selected, based 
on need, to receive more intensive service. The selection was based primarily 
on poor achievement and was executed in both primary and secondary target schools. 
For analytic purposes, a matched group was identified in both FT and ST schools 
as well as the control schools. Five groups were thus identified and are defined 
as follows: 

High Service , Primary Target ( HSPT ) . These primary target children 
are operationally defined as having the service of a remedial or 
resource teacher for at least 26 hours of individual or small group 
instruction plus one or more of these ESEA services: Art; Cultural 

Enrichment; Music; Food Services; Clothing Services; Waiver of Fees 
for Books, Supplies, and Materials; Health Services; Psychological 
Services; Other Special Supplementary Services; Attendance Servi.es; 
Guidance and Counseling; Curriculum Materials Center Services; 

Tutoring and After-School Study Center Services; and Services and 
Instructions for Parents. 

2. Low Service , Primary Target ( ISPT ) . These primary target school 
children are matched with hSPT with respect to school, sex, and 
grade. In grades 2, 4, and 7 they are matched as closely as 
possible on the most recent available reading achievement tests. 

Hone received direct service by remedial or resource teacher 
nor did they receive any other ESEA service except use of the 
resource center and parent education. 
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3. High Service , Secondary Target ( HSST ) . These children were 
located in secondary target schools, where ESEA provisions were 
limited to resource center services and parent education. There- 
fore, "high service" should not be construed to mean the same as 
it did in primary target schools. These children were members 
of designated project classes, which were to be given preference 
in use of the resource center and in the services of the parent 
aide. Only grades four and six had sufficient project classes 

to warrant inclusion. 

4. low Service , Secondary Target ( ISST ) . These children in secon- 
dary target schools were matched with HSST with re*?pect to school, 
sex, and grade. Only fourth and sixth grade pupils were included 
in this group. These pupils were selected from classes other than 
those designated as project classes. Thus, although the resource 
centers were available to them, they did not receive the same 
preferential treatment as indicated for project classes. 

5. ^ Service , Control ( NSC ) . These children were matched with HSPT 
with respect to grade and sex. There are no tenth grade NSC pupils. 
This group received no ESEA services. 

The above sets of children were identified only in grades two, four, six, 
seven, and ten. Such a sample was deemed adequate for assessment purposes. 
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Initially, all children in the above grades vho met the definition of the 
HSPT group were identified and included in the sample providing I 966 
achievement data were available (a small percentage of pupils was absent 
for testing in spite of efforts at "pick-up" testing). The remaining 
four groups were matched with the HSPT group. This strategy is pictured 
below: 

Primary Secondary 

Target Target Control 

Schools Schools Schools 



13 public elementary 
3 private elementary 
If public secondary 


19 public elementary 
10 private elementary 
4 public secondary 


3 public elementarjr 
2 public secondary 






■ 1 




Chspt) ciaPT) 




CSsT) UbsT) j 


CNSC^i 



i 

It is apparent that if criterion measurements respond to treatment 



intensity as defined, it is expected that change scores will reveal: 

1. HSPT>ISPT and 

2. HSST>ISST and that 

3 . the abovONSC 

Comparisons 1 and 2 are most unbiased because each involves the 
same set of schools. Comparisons across PT, ST, and C could contain 
bias since different schools are involved. 
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Criterion Measurements 

The criterion measurements made for program, evaluation are viewed as 
overall complex variables or barometers of educational health. The measure- 
ments are believed to he responsive to program services although this cannot 
be demonstrated empirically. Since individual chapters of this report are 
each focused on one criterion measurement, their characteristics will be 
described fully in that context. 

Table 1 simply presents a summary of the criterion measures along with 
certain pertinent information on each. Information on the reliability and 
validity of some of these measures is lacking, particularly for the survey 
instruments. The student, teacher, and parent surveys have been factor 
analyzed and these results will be reported briefly in their respective 
chapters. 

Data Processing - and Analysis • 

The collection, processing, and analysis of data has been an enormous 
task. For program evaluation alone approximately 18,000 standardized achieve- 
ment tests ware given as well as 30,000 survey and other types of instruments. 
The logistics problem of ordering, packaging, distributing, administering, 
collecting, scoring, and summarizing results = has been staggering;. Standardized 
tests, for sxar.iple, were ordered, hnd packaged by the Division of Evaluation 
Services, administered by teachers, scored by the Division of Data Processing 
(by a Digitek machine), and .analyzed by the Division -.of Program Development. 

The analysis of raw data takes on two basic forms--analysis of target 
pupils and target schools. Where possible, change scores are employed in 
the analysis or other statistical methods; e.g., analysis of variance or 
covariance techriiciues , are used to adjust or account for pre-program variation 
in criteria. Specific anal.ytic techniques will be described in relation to 
each criterion measure. 
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Table 1. Summary of Program Evaluation Criterion Measures 
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Table 1, Summary of Program Evaluation Criterion Measures. (Continued) 
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Finally, it should he pointed out that with the enonnous quantities of 
data generating from this study, it has been necessary to be highly selective 
in what and how data is reported lest this report become too large to be 
useful. We have often skimmed over what is frequently reported in great 
detail in research literature; e.g., our factor analyses, with the idea of 
making this report as readable and concise as possible. 

Organization of this Report 

This report is written in two parts, each corresponding to a level of 
focus, interest, and analysis. Part I attempts to assess the impact of 
Education Act Title I, on the target schools . In Part I the school or the 
target area is the universe toward which generalizations are aimed. As 
stated previously, changes in this universe are unlikely to occur especially 
over short periods of time. Further, the logical attribution of significant 
changes to the Title I program are more difficult to make. Part I consists 
of twelve chapters dealing with teacher, parent, student, and school admini- 
strator surveys: pupil achievement, attendance, promotion, drop-out; measures 
of vandalism and psychological referrals; and a summary arid general findings 
of Part I. In each chapter, the general focus is comparison of status and 
change in PT, ST, and C schools. 

Part II of this report deals with the sample of target pupils described 
earlier. Changes in target school pupils would seem to stand the higher 
probability of demonstration than target schools. Yet, it is important to 
remember that significant change in target pupils will take more time than 
one year to accomplish. 

Parts I and II are followed by chapters designed to summarize the 
major findings and conclusions. 




lOaoMi^ 









PART I 



MALYSIS OF SCHOOIS 
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CHAPTER 2 

RESULTS OF TEACHER SURVEY 

Description 

The teacher survey is an instrument designed to elicit evaluative ratings 
by teachers of a large number of concei)ts and services relating to school, its 
environment, and of course, pupils. The survey administered in June I966 was 
identical to that given in June 1967 except for the latter containing two 
additional items. The surveys were responded to anonymously. Respondents 
did, however, indicate their school, sex, and the grade level in which they 
teach. 

Each of the fifty items on the I967 survey was followed by a seven 
point evaluative scale ranging from 1 (poor) to 7 (good). A rating of 
4 represents a neutal rating. In contrast to most other criterion measures, 
the teacher survey was given in all Cincinnati Public Schools rather than 
just PT, ST, and C. 

Reliability . Some evidence of the reliability of the instrument is 
available. Test-retest reliability from I966 to I967 among item means for 
PT, ST, and C produced a correlation of .876 at the elementary level and 
.932 at the secondary level. 

Validity . While the instrument has a high degree of face validity, it 
is more important to establish its relation to ’’reality." Thus, one may 
ask whether a teacher rating of pupil self-image is really a true measure 
of this attribute. There has been insufficient time to study what this 
survey "really" measures but some attempts have been made. Mean school-wide 
ratings on certain items have been correlated with "real" statistics 
reflecting those items. Table 2 represents a summary of these correlations 
as established on 1966 data. 

From these data it appears that teachers, at least on a school-wide 
basis, make ratings which correspond well with reality. Whether valid 
ratings are made of more abstract concepts such as pupil self-image is 
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not known. 

Table 2. Correlations between Selected Survey Items and Appropriate 
Objective Data. 



Survey 

Item 


Type of 

Objective Data 


Correlation 
^cos pi* 


School Attendance 
of Pupils 


Percent of Attendance 


0-. 

.ox 


Achievement of Pupils 


Sixth Grade Median 
Stanford Achievement Scores 


.88 


Achievement of Pupils 


Percent of School-Wide 
Promotion 


.70 


Parent Participation 
in School 


Percent PTA Membership 
per ADM 


.82 


Parent Involvement 


Percent PTA Membership 
per ADM 


.82 


Supportive Attitude 
of Parents 


Percent PTA Membership 
per ADM 


.87 


Size of my Class 


Mean Class Size 


.47 


Pupil Aspiration 
Level 


Percent of Promotion 


.70 


Motivation of my 
Pupils 


Percent of Promotion 


.55 


Overall Health Level 
of Pupils 


Percent of Attendance 

«« i • ^ ^ 0 


.76 



*Standard errors of these correlations range from ,18 to .20. 



Factor Analysis . The I966 survey was factor analyzed using a principal 
components analysis followed by the varimax procedure. The eight factor 
constellation was selected as most descriptive. The item clusters represented 
by the factors are shown in tables 3 8>>nd 4. As might be expected, the factor 
accounting for most of the variance was the morale factor. Item intercorre- 
lations ranged from .05 to .82 with the majority in the .3 to .4 range. 

Methods of Analysis 

Since one focus of attention is on change in ratings from I966 to I967 
in PT, ST, and C, an analysis of variance model was used. A three-way 



o 
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analysis of variance was applied: years , I966 vs. I967; school group , PT, ST, 
C; and survey items, the 48 items in common from I966 to I967. The item means 
in this 2 X 3 X 48 or 288 cell table were analyzed. Since it is hypothesized 
that PT>increase STMncrease Oincrease, the expectation is significant school 



group by year interaction. This analysis was made separately for elementary and 
secondary level teacher ratings. 

Since the above type analysis is gross, a finer look at the results was made 
by obtaining factor averages by school group and year as well as item averages. 
Results 



Elementary Level Teacher^. Table 3 shows the mean item ratings by year, 
school group, and factor. It also includes the ratings of the school system 
as a whole which show practically identical means from I966 (4.37) to I967 
(4.38). Year differences among PT, ST, and C, however, all show increases: 



PT, +.20; ST, +.29; and C, +.20. Since the latter are contained in the overall 
averages, it would appear that in the remaining schools, a slight decrease 
resulted in I967. This finding loses some significance in that C school 
teachers increased their ratings to the same extent as PT and ST teachers. 

Summary means by year and school group are as follows : 



School 

Group 


1966 


1967 


Diff. 


PT 


4.25 


4.44 


+.20 


ST 


3.97 


4.26 


+.29 


C 


4.22 


4o42 


+.20 


Year Average 


4.15 


inw 


(+.23) 



Group 

Means 



4.35 

4.11 

4.32 



er|c 



The analysis of variance showed no significant year by school group 
interaction, thus failing to support the hypothesis. Year difference was 
significant (F=30.9, df 1,235) with 1967M966. School group differences 
also were significant with PT=OST. 

The most conspicuous increase in ratings were shown in Factor 6 in PT 
and ST schools where the increases were I.56 and 1.85, respectively. These 
gains reflect the establishment of resource centers in all PT and ST schools 



J 








t»bl* 3 . HlWri minltiRii of EinmrrAHY Te*<>her fiurvey by nchool Onup, Yeur, nctor, tnrt Itm. 



Factor 

Item* 



Oroup - Primary 'Dftrp.et. 

Y««r - ’66 ’67 ’67-’66 

H - (337) (391) 

<1) C2)_ (3L 



factor lx lORAtJv 

- Staff 90tz\*t. 

• Profaaaional cooperation amonp^ 
tchool ataff, 

- Teacher-Admlnllitratlon co- 

oparatlon. 

- Teaching In my achool* 

- Pupil- faculty relatlont. 

- School* • attempt to reach 

parontt. 

FACTOK AraACE 

Factor 2: SPECIAL EEUCATION NEEDS 

- Pro'.'islcn for eieot I anally - 

rllaturbed chll'l. 

- Provlalon for socially- 

maladjuoted chlW. 

- Provlaion for physically- 

handicapped child. 

- Preaent curriculum for the 

dtaadvantaged • 

- Provlaion for pupil welfare 

needs. 

FACTOR AVERAGE 

factor 3: niPIL-PABENT CHARAC, 

- Pupil aspiration level. 

- Parent participation In school. 

- Achievement of pupils. 

- Parent In’/olvement. 

- Supportive attitude of parents. 

- The tyr>« ^'f P**pl^* ^ teach. 

- Pipll Imaae of self. 

- School attendanc.' of pupils. 

- Overall health level of p\iplls. 

- Motivation of my pupils. 

- Behavior standards of my 

piaplls. 

- Previous academic preparation 

of my pupils. 

- Pipll acquaintance with total 

community. 

- Decree of tardiness. 

- Pipil discipline. 

- Provlaion for pupil’s cultural 

s^rowth. 

- Provision to challenge able 

learner. 

- lafceUlKlblllty of pupil 

Speech. 

FAtTOR AVERAGE 

Factor hf CONDITIONS FOR INST. 

- Teacher time to plan. 

- Slr.e of ray class(es). 

- Time to teach. 

- Time and place for jmplls to 

study. 

- Provlaion for acariemlc 

remediation. 

FACTOR AVERAGE 

Factor 5: IMPROVING SCH. PROG. 

- Provision for visiting teacher 

services. 

- Provlaion for supervisory 

personnel. 

- In-service training. 

- Field trip opportunities. 

- School’s provision for pupil’s 

health. 

- Adequacy of enrichment 

activities. 

- Help In handling disciplinary 

prohlema. 

- Adequacy of Inatructlonal 

media. 

FACTOR AVERAGE 

Factor 6: LIBRARY RESOURCES 

- Adequacy of school lib*, ory. 

. Availability of professional 
reading matter. 

FACTOR AVERAGE 

Factor 7: BOOKS AND SUPPLIES 

- Adequacy of supplies. 

- BooKa availAhle to my class. 

FACTOR AVERAGE 

Factor 8x SCHOOL PIANT 

- Adtq^iacy of school pUyground. 

- Adequacy of school building. 

FACTOR AVERAGE 

Factor 9t EDUCATION ACT 

- My aaaeasnent of Education 

Act program. 

• Ky unde/atanding of Education 
Act prograai.. 

FACTOR AVERAGE 



U.PP 

*).2h 

S32 

U.90 

6.36 

'.J9 



U.Po 

s.2^: 
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u.ro 
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5.17 
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U.26 
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U.69 
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**.73 
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2.P1 
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3-50 
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+ .10 
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4.62 
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3.12 


2.93 


2.95 


+ .02 
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4.60 
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3.40 


+ .17 


?.i 3 


3.71 


3.44 
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3.?'* 


3.57 


3.40 
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3.20 


3.43 


3.54 


+ .11 


3.26 


4.3^' 


4.20 


- .U* 


4.19 


3.99 


4.07 


t ,ry,' 


4.03 


4.45 


4.V* 


0 


4.06 


4.05 


3. '■^6 


- .20 


3.f^o 


3.56 


3.5*v 


0 


3.52 


3J7 


3.96 


+ .09 


3.^)0 


4.03 


4.07 


+ ,04 


4.07 


3.1'3 


4.00 


+ .11 


3.6f 


4.52 


4.56 
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4.25 
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+ .16 
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5.00 


+ .pr 


4.P1 
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+ .40 


4.77 


5.00 




♦ .13 
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4.2- 



+ . O'l 
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- .42 

- .71 


5,12 

4.P7 

U.PP 


5.02 

4,73 

4.78 


- .10 

- .14 

- .10 


4.61 


4.62 


+ .01 


5.03 


4.96 


- .07 


5. Vi 


u.ro 


- .37 


4.64 


4.63 


- .01 


4.2P 


4.93 


+ .65 


4.P7 


4,95 


♦ .08 


5,00 


5.1P 

U7T 


+ .18 
- ,07 


4,85 


5.07 

XX 7 


+ ,22 
- .0? 


3.72 


4.00 


+• .«:r 


4.39 


5.19 


+< ,80 


4,20 

3^9^ 


4.52 


+ .30 


4.PQ 

ir:^ 


5.27 


♦ .46 


5,63 

4.<^P 

57?^ 


s.sF 

m 


- .05 
+ .43 

+ .19 


5.20 

4.87 

5.0I* 


5,28 

iie 

5.23 


+ .OP 

tiIo 


3.09 

iJH 


3.52 

342 


+ .43 

+ .28 


4.OP 

4JU 

C21 


4,20 


♦ .12 

i-tii 

♦ .15 




3.86 






H.13 






4.0^^ 

3.*^7 






u : s 2 

i»7i? 




14.?? 


ii.hs 

, P 0 




!*.37 

+ 


4,38 

.01 
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over the past year. Elementary teacher ratings in PT and ST surpass those 
given in all schools. 

Factor 1, morale, continues to he high but unchanged from last year. 
Little difference in morale among school groups is noted. Target school 
teachers, for example, rate "teaching in my school" about as high as 
teachers in general. 

Factor 2, special education needs, has items directly related to ESEA. 
services. For I967, PT>STX!, althou^ C showed more gain from I966, The 
factor 2 means generally are considerably below the neutral point of 4.00 
indicating that more needs to be done especially for socially and emotionally 
maladjusted children. 

Factor 3> pupil-parent characteristics, best represents the teachers’ 
evaluations of their pupils. Both PT and ST show lower ratings tlian C or 
system-wide ratings. Little change is noted in PT while ST increased to 
a level eq^ual to PT for 1967* 

Factor 4, conditions for instruction, reflects some of the ESEA program 
emphasis and reveals PTi^TXJ both in average rating and change. This finding 
supports the general hypothesis. Ratings for class size, and time and place 
for pupils to study showed the greatest improvement and correspond to ESEA 
efforts . 

Factor 5, improving school program, shows little change in any school 
group from I966 to I967. PT ratings are highest in both years certainly 
reflecting ESEA program thrusts. PT ratings of instructional media and 
enrichment activities are highest as well as field trip opportunities in 
spite of the fact that the latter showed a significant decline. Field trips 
were, in fact, reduced this past year due to less funds available in fiscal 

1967. 

Factor 7> books and supplies, also shows a significant increase for 
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PT and ST. Since ratings of all school groups are over the five point level, 
teachers apparently feel that books and supplies are adequate. PT means are 
generally higher than ST, C, or system-wide ratings. 

Factor 8, school plant, shows equal increases from PT, ST, and C 

oT-1-V.^.ir.Vi 4-Via fliror>orroe eVirnj- a t.fanr^Pnf»V -Pnv PT ST C! f’OT' 1Q67. 

Factor 9, Education Act, shows what might be expected, that primary 
target school teachers show more understanding and assess the program better 
than ST or C teachers. These two items were not included in the i960 survey; 
therefore, changes cannot be assessed. 

Finally, it is interesting to note that in both I966 and I967 the highest 
mean item rating was obtained from the item "teaching in my school" followed 
by "teacher-administration cooperation," while the tvro items rated lowest 
continued to be provision for emotionally and socially maladjusted children. 

Secondary Level Teachers . Table h sunmarizes the meein ratings and year 
differences for secondary level teachers. Inspection of the last row of 
table 4 shows an overall decrease of .02 in PT schools; an increase of .18 in 
ST schools, and an increase of .44 in C schools. This finding is in contrast 
to that at the elementary level which showed increases to be uniform across 
PT, ST, and C. The means and differences are summarized below by year and 
school group. 



School 

Group 


1966 


1967 


Diff. 


Group 

Means 


PT 


4.23 


4.21 


-.02 


4.22 


ST 


3.89 


4.07 


+.18 


3.98 


C 


3.84 


4.28 


+.44 


4.06 


Year Average 


3.99 


4.19 







The apparent interaction shown in the differences above was verified 
through the analysis of variance. Thus, in terms of change alone, C schools 
changed most followed by ST schools, with PT schools remaining essentially 
the same as in 1966. In addition, the analysis of variance revealed a 
significant difference among groups with PT (4.22) ST (3.98)=C (4,06). 

er|c 



fioi* 4 . rtean R*tln«a of GSCCSTAmr Teacher Survey by School Oroup> Year, Factor, and Itwa. 



Ftetor 

Xtaaa 



Group - Primary Tamat 
Year • ’67 ’6V-’66 

« . (215) (190) 

(1) (2) (3)__ 
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All School^ 



•66 ’67 

(loP) (f6) 



iiiL 



(V) 



factor It K)FAB ^ ^ 

• Staff Korole* ^*1^ 

« Profaciional cooptration coong 

ochool staff. s.?6 

• TMcbar*Adb«inl8tratlon co* 

operation. ‘?.5‘5 yhO 

• Teaching In ny school. ?.3^ 5.3^ 

• Pupll-ftMjulty relations. ^.99 ^*^'3 

« School*s ettOBpt to reach 

parents. 3*20 

FACTOR AVERAGB 3*27 3.13 

Factor 2: SPECIAL HHJCATIOK NEEDS 

- Provision for cootlonally- 

dleturbfid child. 3*6P 2.93 

- Provision for soclally- 

salad.lustec child. 3.17 3*13 

- Provision for physlcslly- 

htuidlcapped child. 3.35 

• Present c»arrlculum for the 

disadvantaged. U.Uh h.35 

- Provision for pupil welfare 

needs. 

FACTOR AVERAOK, 3.^7 

Factor 3t POPIL-PAKRST CHARAC. 

- Pupil aspiration level. 3*15 3.?3 

• Parent participation h: school. 2.00 2.06 

• Achievement of pupils. 3*67 3*60 

- parent Involvement. 2.‘*1 2-Y6 

• Supportive attitude of parents. 2.93 2.97 

• The type of piplls I teach. 3-^9 3.3^* 

- P>ipll Ina^e of self. 3*2’. 3-11 

- School attendance of pupils. 3.15 2.97 

- Overall health level of pupils. U.^o U.O*v 

- Motivation of my pipils. 3 -^‘3 



- .le 
. .16 

- .13 

+ .06 

- .16 

«. .22 



- .13 

- .02 

+ .00 

- .n<> 

- .Oh 

- .1*3 



+ .oy 

+ .(y'i 

- .07 
+ 

. 0 ? 

- .11 
- .10 
- .1^ 
+ .0 • 
- .06 



^».99 

»^.32 

3.25 

5.P0 

U.Ul 

1.12 

5.03 



2.2J 

c. r-> 

2.<*3 

3-30 

U.(/ 



2. J3 
2-20 

3. -V' 
2.7*5 
3-13 
3.23 

2. ^3 

3. V7 

3.93 

3.21 



h.23 

•^.iv 

5.3^? 

5.15 

*4.35 

U.% 

TI7T 



P.hV 

r #• 

3. -^ 

3.7- 

4. */. 

37^ 

3-?2 
- .. 
3.‘>? 
3.09 
3.iii 
3-» 2 
3.3»t 
3.3? 
U.l^: 

3. ‘^•4 



*67- *66 
(6) 


•66 

‘tl! 


•67 


•67-*66 

(9) 


•66 

's?> 


*67 

(29eif) 

(11) 


*67-*66 

(12) 


- .76 


h.32 


5-44 


4-1.12 


4.93 


4.75 


- .18 


- .13 


5,52 


5.65 


+ .13 


5.41 


5.29 


- .12 


4- .07 

- .03 
4- .14 


5.33 

U.of- 
It, 05 


6.36 

5.44 

4.62 


4-1.03 
+ .46 
+ .57 


5.32 

5.59 

5.04 


5.46 

5.57 

4.97 


4 .14 
. .02 
- .07 


t 1 1 


U,f0 

U75 


5.31 


4- .64 


5.44 

5.29 


5.26 

5.22 


• .18 


4- .I*"- 


2,63 


2.7" 


4 .13 


2.73 


2.75 


4 .02 


A. Ol- 

. J • 


2,66 


P.73 


4- .0*^ 


2.73 


2-^4 


4- .11 


4- .00 


2-*’-3 


3.27 


+ .34 


3.43 


3.39 


- .04 


+ .4s 


3, Jo 


4.41 


+ .52 


3.?1 


3.^4 


4 .03 


« .QO 


iLf:! 


4.40 


- .lU 


4.F4 


4.71 





4 .3(. 



4- .39 

+ .3? 
+ .16 
+ .33 

4- .01 

4- .V- 
4- .31 
- .23 
» .26 
+ .33 



2- "*2 
2.14 
3.44 
2.6?^ 
2.6p 
2M 
3.40 

3.35 

4.10 

3.13 



3.1^ 

2.55 

3.64 

3.13 
2.06 
3.63 
3.35 

3.14 
4.16 

3.45 



+ .66 

4- .41 

4- .20 

4 .45 

4 .34 

4 .63 

- .03 

- .21 

4- .06 

+ .3? 



3.30 

4.31 

3.51 

3.Q7 

4.01 

4.03 

4.52 

4.65 

4.4s 



3.94 

3.27 
4.07 
3.64 
3.70 
3.90 
3.00 

4.27 
4.66 
4.3^ 



+ .13 

- .03 
. .24 

+ .13 

- .27 

- .11 

- .06 

- -25 

+ .01 

- .07 



pupils. 

- Previous actdcmlr preparatJon 


3.^3 


3.60 


-.14 


3.4^ 


3.6V 


^ .2? 


2.f37 


3.42 

3.4^- 


+ .45 
4 ,26 


4.26 

3.Q6 


3*99 


- *27 


of my pupils. 

- Pupil acquaintance with total 


3-13 


2. os 


- .1*' 




3. r- 


4- .11 


3.22 


3.7'; 

3.06 


- .21 
- .10 






4.06 


ccBcumity. 






0 


3.33 




- ,04 


3-22 


3.'^! 


+ .29 


- Defnree of tardiness. 


2.96 


2.*6 


- .10 


3.21 


3.’- 


4> .04 


3.32 


3.n» 


4 .52 


4,20 


U. 17 


- .12 


• Pupil discipline. 

- Provision for pupil's cultural 


U.oi 


3.'^3 


- .0^ 


3.30 


3.7^- 


4- .46 


2.6f* 


3-69 

4.42 


41.01 


4.04 

4.49 


U .09 

h.U5 


* .05 

- .ou 


growth. 


l»,29 


4.19 


- .10 


3. 64 


3.’^ 


f .24 


3.^^3 


4 .59 


- Provision to challenge able 




















4.68 


U.62 


- .06 


learner. 


U,39 


4.21 


- .1^ 


4.0T 


4.60 


4 .52 


3.0*4 


4.82 


+ .8? 


- Intelllrlblllty of p*jpll 














3zZ 

3.1^ 








3.P7 

tiolT 


.60 

- .05 


speech. 

FACTOR AVERAGE 
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3,4? 


2.«5 

3T3? 


- .06 


ii4 

3^ 


3.32 

3T4T 


4 .1? 
4 ,?4 


ioo 

3.5T 


+ .12 


3.27 

47o9 


Factor h: COKDITKMfS FOR INST. 




















3.46 


3.2ft 


- .18 


- Teacher time to plan. 


I».03 


3.9? 


- .05 






- .01 


3.62 


3.74 


+ .12 


- Size of my clsos(es). 


U,3U 


4.76 


4 .42 


3.76 


4.74 


4 .o, ' 




4.06 


4 .51 


3.97 


lt,UU 


-► .47 


- Time to teach. 

- Tine and place for pupils to 


U.70 




- .01 


4.'i5 


4.90 


+ .3'* 


4.44 


4,23 

4.39 


4 .39 
+ .60 


4.76 

3.21 


U,80 

3.B2 


.04 


study. 


3-f’O 


3.93 


• .13 


3.44 


3.1*5 


- .25 


3.79 


+ .01 


- Provision for academic 




















Mi 






remediation. 


4,22 


4.39 

4.3'’> 


4- .16 


hZ 


3-91 

Coo 


4 .?> 


3.4/ 


Oh 


4^ 


±M2 


FACTOR AVHRAGE 


*■ .13 


3.»1 


3.r; 


4 .39 


3.99 


Or 


+ .09 


Factor 5: IMPR0VIW5 SCH. PROG. 


























- Provision for visiting teacher 
















4.43 




4.81 


U,Pl 




services. 


U,59 


5.06 


+ .47 


4.41 


4.5f^ 


4- .17 


3.*^ 


4 .51 


0 


- Provision for supervisory 


























personnel. 


5.19 


5.0T' 


- .11 


4.60 


5.03 


4- .43 


4.60 


4.75 


4 .15 


5.12 


5.02 


- *10 


- In-service training. 


4,72 


4.90 


4- .2 7 


4.7:' 


4,32 


- .40 


4.45 


4.71 


4 ,26 


4.87 


U.73 


- .14 


- Field trip opportunities. 

- School's provision for pupil's 


5,F6 


5.23 


- .65 


4.2*? 


4.10 


- .06 


4.52 

4.52 


4.77 


4 .25 
4 .49 


4.P8 


U.TP 

U.96 


- .10 


health. 


<5,61 


5.37 


- .24 


4.7»' 


4,t^ 


4- .22 


5.01 


5.03 


- .07 


- Adequacy of enrichment 

activities. 

- Help in handling disciplinary 


4,72 


4.56 


- .16 


3.V6 


4.14 


4- .V 


3.92 

4.63 


4.43 


4 .51 


4.64 


I».63 


- .01 

.06 


5.65 


4.87 


U.05 


problems. 

- Adequacy of Instructional 


5. 1*3 


5.42 


- .01 


4.68 


5.16 


+ .4f 


41.02 

4 .61 


4.*^2 




4.85 






media. 


5.0ft 

5.15 


Ml 

5.09 


- .07 


4.61 


4.60 


- .01 




5.07 

07 


* .22 


FACTOR AVERAGE 




07 


432 


4- ,15 


4:39 


4 .67 




Factor 6; LIBRARY RESOURCES 












4- .06 


4.51 


5.41 




U.39 




+ .80 


- Adsqumey of school library. 

- Availability of professional 


u.qfi 


5.07 


4- .09 


5.53 


5.9« 


4 .90 
4 .44 


5.19 


- ,16 


4.54 

43 


4.98- 


4.89 

4.^ 


^ .46 


reading natter. 


4j27 


5.06 


4- .09 


5.16 


5.00 




FACTOR AVEKAOB 


5.07 


+ .09 


5.35 


5.30 


- .05 


5.20 




5.27 




Factor 7: BOOKS AND SUPPLIES 


















4 .64 








- Adequacy of supplies. 


5.13 


5.31 


4- ,18 


4.82 


5.34 


+ .52 


4.76 


5.40 


5.20 


5.2fl 


♦ .06 


« Books available to ley class. 


5T9C 


4.90 


4- .16 


4.39 


M2 


* .46 


4.61 


4.95 

OF 


4 .34 
^^749 


4.87 

5T^ 




♦ .31 


FACTOR AVERAGE 


5.11 


+ .17 


5.10 


+ .49 


4,69 


5.23 


+ .20 


Factor 8; SCHOOL PIAITT 
















4.83 










« Adequacy of school playground. 


3.72 


4.02 


4- .30 


3.69 


4,07 


+ .38 


4.40 


4 .43 


4.08 


4,20 


+ .12 


« Adequacy of school building. 


U.l*8 


4.83 




few 


4,11 


- .40 


4.43 

O2 


5.40 


4 .97 


4.34 


Mi 

4.36 




FACIDR AVIHAGB 


l»7io 


+ .33 




- .01 


5.12 


4 .70 


factor 9t BDUCATIOIf ACT 


























- Hy aesesMent of Education 
Act program. 

• Hy understanding of Educstlon 




4.31 






3.P2 

3,7ft 

37^ 






3.U5 

m 






4.13 

4,22 

irrip 




Aot progrsR. 
fACIDR AVMOE 




4.81 
















AVniMX FOR M OOMOH 1186 


4.23 


U.21 




3*P9 


4,07 




3.84 


4.2«^ 




J»,37 


4,38 




Dwuuama 196? - 1966 


m 


.02 




4- 


,1F 




-f 


.44 






.01 





athls total Ineludts PT^ 8 T» and C, at wall os all elementary and secondary schools. 
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Finally, a significant difference was noted from I966 (3*99) ‘to 1967 
Thus, all three sets of schools apparently increased in their e’/aluations 
of the various concepts and services. The small change noted in PT is 
apparently a function of the high ratings given by these teachers in 
i960 compared to ST or C teachers. In I967 a leveling off phenomenon has 
occurred which makes all three sets of schools look much more alike in their 
ratings. It will be noted that secondary teachers in general rated these 
concepts and services lower than did elementary teachers, this phenomenon 

appearing in the I966 analysis also. 

Certainly a striking feature of these data is the consistently higher 
rating increases made by the C school teachers. ^Jhy this occurred is not 
known but one possible answer is that one of the two original control 
schools ceased operation in grades 7 and 8 and became an elementary school 
only. A new junior high school was built which accommodated both pupils 
and some staff from the original control school. Thus, the new junior 
high w^as used as the control school in I967. Perhaps being in a new school 

has an enhancing effect upon teacher ratings. 

Comparison of mean gains between FT and ST shows ST>PT; a reversal of 
the general hypothesis. This is accounted for, however, in terms of the 
originally high (1966) PT ratings. Thus, ST schools are simply catching 
up to the PT ratings. The two sets of schools are not yet the same since 
the overall PT mean for 1967 is 4.21 compared to 4.07 for the ST schools. 

Factor 1, morale, shows an overall decrease except in the two C schools. 
ST schools show the lowest I967 mean (4.68) followed by PT (5‘13) &nd C 
(5.51). Decrease in staff morale, while still high, may have resulted from 
two defeats of school levies and other adverse situations occurring during 
the year. 

Factor 2, s£;ecial education needs, shows the lowest teacher ratings. 
While gains were highest in ST, the means continue to show PT>ST=C. Secon- 






o 
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dary teachers as well as elementary teachers continue to express their concern 
over adequate provision for socially and emotionally maladjusted pupils. 

Both change and I 967 means in Factor 3j pupil-parent characteristics, 
show This is again a reversal of the general hypothesis. Perhaps 

the best indication of desirable behavioral change will have occurred when 
this factor reaches a point where PT averages near the system-wide norm. 

Factor 4, conditions for instruction, shows C>ST>PT in terms of change 
but PTX!>6T in terms of I 967 averages. Class size ratings improved greatly 
in all school groups and the school system. 

Factor 5j improving school progiam, shows in terms of change 

but PT highest in terms of mean score; hi^er, in fact, than the system-wide 
average. Field trip opportunities in PT was rated considerably lower than 
it was among elementary PT teachers reflecting the cutbacks in this area due 
to limited funds. 

Factor 6, library resources, is rated high by all school groups but in 
?T is relatively low in comparison to ST and C. The high increase (,90) in 
C is due probably to the opening of the new school. 

Factor 7j books and supplies, is rated high in all school groups with 
little difference among groups. 

Factor 8, school plant, shows generally higher ratings except in ST 
schools where both the means and positive change are lowest. No ESEA. funds 
were spent for playgrounds but during the first year some were spent for 
remodeling in a few schools. 

Factor 9? Education Act, reveals that PT teachers assess and understand 
the ESEA program better than other teachers. Ratings given by all secondary 
teachers are higher than those given by ST and C. 

Discussion 

This chapter has attempted to assess ESEA impact through a teacher 
evaluation device where fifty items representing various concepts and 
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services were all rated on a "poor" to "good" scale. The surveys were given in 
May 1966 and May 1967. Attention was focused both on mean I967 ratings and on 
rating changes from 1966 to I967 among FT, ST, and C school teachers as well as 



all teachers. 



Perhaps the hest svanmary 






Uiic; 



-hnVklo c; t.rb'tr^Vi 



records the rank order of factor means and factor mean differences without 
regard to significance of difference. "All" in table 5 refers to all teachers 
in the school system; the data being taken from the last three columns of tables 



3 and 4 . 

The 1967 status of elementary teacher ratings shows PT ratings highest in 
six of the nine factors while ST is hipest in five of the nine factors in terms 
of change . The higher ratings in PT schools reflect factors which measure 
concrete, visible objects or services. A teacher can literally see a special 
class in operation, or a resource center or a place to study. More abstract 
concepts such as aspiration, motivation, self-image, morale, require more 
subjective judgment and it is in these factors where PT change and status 
were lowest. Probably the best indication of the success of the ESEA program 
will be shown by significant increases in the pupil-parent characteristics 
factor. Certainly elementary teachers in target schools believe their teaching 
situation, exclusive of pupil-parent characteristics, to be as good or better 

than the average teacher in the school system. 

The general findings at the secondary level are not as favorable to the 
general hypothesis as they are at the elementary level. PT ^ ' jngs in I967 
are highest in four of the nine factors while lowest in two. The ratings of 
"all" teachers ranks first or second in six of the nine factors. Gains were 
highest among C schools in six of the nine factors while ST showed most gain 
on the remaining two factors. The high gains in C schools are believed to be 
caused by the opening of a new (control) school. 







V 
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Table 5* Rank Order of Means and Changes from I 966 in Factor Ratings for 
Various School Groups on the Teacher Survey. 





Factor 


Mean 


Factor 


Mean for 


Factor Change 




1967 


1967-1966 




ELEMENTARY TEACHERS 


1. Morale 


C > ST > PT >A11 


ST > PT > C >A11 


2. Special Education 






Reeds 


PT >A11 > ST > C 


C > PT > ST >A11 


3 . Pupil -Parent 






Characteristics 


C >A11 > PT > ST 


C > ST > PT >A11 


4. Conditions for 






Instruction 


PT >AU > ST > C 


PT > ST >A11 > C 


5 . Improving School 






Program 


PT > C >A11 > ST 


ST > PT >A11 > C 


6. Library Resources 


PT > ST >A11 > C 


ST > PT >A11 > . C 


7 . Books and Supplies 


PT > C >A11 > ST 


ST > PT >A11 > C 


8. School Plant 


All > PT > ST > C 


ST > C > PT >A11 


9 . Education Act 


PT > ST >A11 > C 




Total All Items 


PT > C >A11 > ST 


ST > PT = C >A11 




SECONDARY imCHERS 


1.. Morale 


C >A11 > PT > ST 


C >A11 > PT > ST 


2. Special Education 






Needs 


PT > C >A11 > ST 


ST > C >A11 > PT 


3 . Pupil -Parent 






Characteristics 


All > C> ST > PT 


C > ST >A11 > PT 


k. Conditions for 






Instruction 


PT > C > ST >A11 


C > ST > PT >A11 


5 . Improving School 






Program 


PT >A11 > C > ST 


C > ST >A11 > PT 


6. Library Resources 


ST >A11 > C > PT 


C >A11 > PT > ST 


7 . Books and Supplies 


All > . > PT > ST 


ST = C >A11 > PT 


8 . School Plant 


C> PT >A11 > ST 


C > PT >A11 > ST 


9 . Education Act 


PT >A11 > ST > C 




Total All Items 


All > C> PT > ST 


C > ST >A11 > PT 
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Li closing this discussion it is worth noting that desirable changes in 
pupil behavior (factor 3) are at the heart of ESiiA progrem goals, most difficult 
to bring about, and most difficult to assess. 
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CHAPTER 3 

RESULTS OF SCHOOL ADMINISTRATOR SURVEY 



Description 

The school administrator survey involved an instrument identical to the 



teacher survey save for several items which were inappropriate for school 



administrators. It was given at the same time as the teacher survey to 
school principals, assistant principals, and administrative aides. It was 
given anonymously as was the teacher survey. The results of the two surveys 
were kept separate not only because some of the items were different but 
because administrators "see” the school situation from a quite different 
perspective than do individual teachers. This survey was given system-wide 
as well as in PT, ST, and C schools. 

Since the results of the I966 administrator survey were not factor 
analyzed last year because of the small number of ratings made, it was 
assumed that the factors would parallel those of the teachers. Different 
items were placed into factors rationally, rather than empirically. 

Methods o:f Analysis 

Analysis of the administrator survey paralleled that of the teacher 
survey with two exceptions. First, control school results were not analyzed 
simply beceiuse so few ratings are involved. With only three elementary and 
two secondary control schools, the maximum number of adminstrators ratings 
in each group was less than ten. Secondly, results were analyzed by 
combining elementary and secondary level ratings within PT schools and 
similarly within ST schools. Again only four PT and four ST secondary 
bchools are involved and the number was too small to be of sufficient 
reliability for analysis. Thus, the three-way analysis of variance consisted 
of two school groups (PT and ST) ; years , 1966 and I967; and items , 48 items 
common to both years. The result was a 2 x 2 x 48 table of item means. 

The above gross analysis was followed by less analytic procedures where 
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factor and item means were compared by inspection. Other infomal comparisons 
were made with system-wide administrator ratings. 

Results 

Summary of the results is shown in table 6. Inspection of the grand means 
at the bottom of table 6 foretells the results of analysis* There was a 
significant year effect with I967 ratings ( 4 . 64 ) higher than ?*966 ratings ( 4 . 11 ), 
Ratings of PT school administrators were significantly higher ( 4 * 51 ) than those 
of ST administrators ( 4 . 24 ). Finally, significant interaction was noted with 
PT increasing by .66 and ST by .39 from I966 to 1967. PT ratings were higher 
in 1966 and in 19^7 ajid increased more than ST ratings. 

There were considerable differences in ratings among the various factors 
both in terms of I967 means and change over I966. First, one is impressed 
with the fact that adminstrator ratings in general are quite high. With the 
exception of special education needs, all mean factor ratings among PT 
administrators are over 4.00. The same is true among ST except for factor 3 
where the mean rating of pupil-parent characteristics is a little below 4.00. 

Tiie only factor rating decrease (-.11) was in morale with ST schools. In 
spite of this decrease, the I 967 rating is quite high (5*48). PT morale, 
while increasing .20 in I967, was the lowest increase in factor means within 
PT schools. The two highest I967 factor ratings were factors 6 and 7 s library 
resources and books and supplies; this being true in both PT and ST schools. 

This finding is consistent with tie teacher survey and certainly reflects to 
a large extent the resource centers which were installed in all PT and ST 
schools. The two lowest I 967 factors in both PT schools and ST schools were 
factor 2, special education needs, and factor 3» pupil-parent characteristics. 

From the vie\-/point of change , PT increased most in factors 6, library 
resources, and factor 5? improving school program, while ST changed most in 
factor 6, library resources, and factor 7? books and supplies. 



r«l)le 6 , Me«n Ratings of Adralnlitrator Survey by School Group, Yeart Factor, nn'l Item. 



Factor 

Itrm 



Factor 1: M0RAI£ 

• Staff morale* 

• Professional cooperation amorjR s»;hool otaff. 

- Teacher- Administration cooperotlon, 

- Pupil- faculty relablona. 

- School*?? attempt to reach psirents. 

- Challenge of my position. 

- Extent of teacher absenteeism. 

• \fy Involvement in decla*oiis affectli.r 

my fchool. 

- Principal’s voice In policy making. 

FACTOR AVERAGE 

Factor SPECIAL EWJCATION 

- Provision for emoti onally-fUsturbed chill* 

- Provision for social ly-nvilad.hio ted child. 

- Provision for pliyslcally-handlcoppcd nliild. 

- Present currlculnn for the dlsadx'antaged. 

FACTOH AVERAGE 

Factor 3: PUFIL-PAHrOT t'HARACTKRKTIC; 

- J'ttpll aspiration level* 

- parent portlcipatlo . in school* 

- Pupil achievement. 

- Parent involvement. 

- Supportive attitude parents. 

• The type of pupils in my school. 

- Pupil image of self* 

- Pupil attendance. 

- Overall health level of pupils. 

- Motivation of pupils. 

- Behavior standanls of pi>pll8. 

- Previous academic preparation of pupllr. 

- Pupil acquaintance with total community. 

- Degree of pupil tardiness. 

- Pupil discipline* 

- Provision for pupils* ctiltural fcrowth* 

- Provision to challenge able loorr.er. 

FACTOR AVERAGE 

Factor U: COHDITIONS FOR INSTWJ'rrfON 

- Teacher tine to plan* 

- Time for teachers to teach* 

- Time and place for pupils to study* 

- Provision for academic remediation* 

- Teacher-Pupl 1 ratio* 

FACTOR AVERAGE 

Factor 5: IMPROVTW; GCHOOL PROGRAM 

- Provision for visiting teacher ser’/ices. 

- Provision for supervisory personnel* 

- Adequacy of In-service training* 

- Field trip opportunities* 

- School's provision for pupil health* 

- Adequacy of enrichment activities* 

FAtTOR AVERAGE 

Factor 6; LIBPARY RESOimCES 

- Adequacy of school library* 

- Availability of professional reading matter* 

FACTO’^ AVERAGE 

Factor 7: BOOKS MJD SUPPLIES 

- Adequacy of supplies* 

- Availability of books* 

FACTOR AVERAGE 

Factor 0: SCHOOL PIAWT 

- Adequacy of school playgro'Jind* 

- Adequacy of school building* 

- Adequacy of parking facilities* 

- Adequacy of pupil I'mchroom facilities* 

- Adequacy of faculty lunchroom facilities* 

FACTOR AVERAGE 
Factor 9: EDUCATION ACT 

- My assessment of Education Act program. 

- My understanding of Education Act program* 

FACTOR AVERAGE 



Group - Primary Target 

Year - '66 '6',' '67--66 



Secondtry Tarpet 
•66 *67 * 67- *66 



(49) m 

JsL 






-ja. 



•66 

(PI) 

J2L 



otbw* 

•67 

(7C) 



•67-*66 

- 



AVDRACE FOR 48 COMMON ITEMS 
DIFFERENCES I 967 - 1966 



:>*r' 


G.v: 


+ .27 


S.66 




- *31 


5.70 


*^.45 


- .33 






4 *r> 




, t 


+ .05 


S.09 


5.70 


- *U 




» .1 


+ *?/ 


t 1 •• 


q.vf. 


- .1.^ 


6.11 


6*04 


- .07 






+ .11 




s.36 


- .CK" 


5.Q3 


5.74 


• .19 


5.0O 


.73 


f j 


s,4n 




4 .01 


S*76 


5.73 


• *03 






* * 10 


'..If 


s/n 


+ ,0'> 


iuP.Z 


6.33 


e *11 


h / r ' 


4.73 


- ,1V 


4*fv; 


4/0 


- .36 


5.33 


4,97 


- .36 










5.V3 






5*51 












5*40 






5*10 


TOC 








'•*'/4 




- *11 




5.72 




3*15 


+i*r? 


1*10 


2.41 


+ *61 


2.29 


2*36 


♦ *07 


p.irs 


p*r>3 


+ *47 


1*02 


2. ‘‘4 


+ .62 


2.51 


2*91 


+ *40 


3.V* 


3.73 


+ .14 


2*S7 


3.U 


+ ,60 


3.53 


4*19 


♦ *66 




4.56 

3.'?^ 


+l*o4 
4*: 73 


2*90 

2.3*> 


3*70 

2*fv> 


4 *ro 

-J- .(jOi 


2.9P 


3*60 

3.27 




3-1'’ 


4.17 


41* ^37 


3.14 


3.* 3 


4 .69 


4*99 


5*23 


+ 24 




3.?3 


4 *S3 


3*00 


3.SS 


4 *55 


4*02 


4.07 


•4 *15 




4*17 


4 *35 


3.43 


4.11 


4 *6P 


5*26 


5*20 


*02 


3*^^3 


3.'>X 


- 


3.41 


3.52 


4 *11 


4*95 


4*91 


- *04 


't.io 


4. Si* 


4 .33 


4.3‘i 


4. A3 


4 *?P 


5*57 


5*41 


- *16 


3.41 


3.^3 


4 .42 


3*60 


3.^0 


4 .01 


*■-*31 


5.25 


- *06 


3*?*> 




1 


3.3^ 


3. "7 


4 *51 


4*00 


3*23 


4“ *25 


3*<^d 


4.:*3 


4 .3^ 


4*04 


u.*io 


- *04 


5.75 


5*14 


- *61 




4.^s 


f *0^1 


4.17 


4*S6 


4 .30 


S.71 


5.50 


- *21 


3.W 


4*4t' 


*S1 


3.s; 


4. If 


4 *62 


5.33 


5.27 


- ,06 


U**>3 


ii*iv 


- .3^'* 


4*47 


4.00 


- .39 


5.65 


S*13 


- .52 


3.06) 


3.J 3 


1 *"^s 


3.30 


3.6Ji 


4 .34 


4.67 


4*62 


- .05 


3.34 


'1*2? 


+ .**3 


3.00 


3.75 


4 .60 


4*73 


4,75 


4- .02 




3. *1 


4 *10 


3.5s 


3.32 


- *03 


5.25 


5.04 


- *21 


3.0G 




- *2'> 


4.57 


4.G3 


4 .06. 


5*73 


5*36 


- *37 


U*13 




^ *P7 


3.40 


4**^2 


+1.04 


S.20 


5.49 


4 *29 


h . P'j 

37^ 


U.c * 


♦ .42 

f *4s ^ 


3.01 


h . ft > 

T.^ 


4i*a*^ 

4 *33 


ii2 

5*25 




4- *14 
- *07 


ii*(y^ 


4.70 


+ *r,4 


4*35 


4.70 


4 *43 


4*56 


4*50 


- *06 


G*19 


s.V 


4 .35 


5*16 


5.50 


4 .34 


5*67 


5*63 


- *04 


3.UP 






3.07 


3.f*4 


4 * 77 


4.22 


4*33 


4^ .11 


3.SP* 


s.y'. 


»1*6? 


3*20 


3.00 

4.W 

TO 


+ *79 


3/f6 


4.29 


4^ .53 




5*71 


fl*lP 

4 


4^ 

4*03 


4 *57 


4*25 

0*9 


4,07 

TO 


♦ *62 
4 .23 


n*3T 


S.23 


4 S 


4*43 


5.05 


4 *62 


5.23 


5*30 


4 .15 


hr/y 


5*2S 


+ 


4*61 


S.QQ 


4 *40 


5*41 


5*51 


4 .10 


U*t52 


S.29 


< *T^ 


4*37 


U.-/2 


4 *35 


5.03 


5*10 


4 *07 


U*47 


s*<>6 


♦ 1*40 


3*71 


U.sG 


4 *05 


5*32 


5.73 


.41 


4*?^> 


S.30 


»l* *s 


4.34 


4.53 


4 .19 


4*65 


4*01 


♦ *16 


U*16 


s*4r 


41*3:^ 


SS 


4,51 


41*17 


5^07 


5:21 


4 * *14 




s*^ 


+1*03 




4 .?> ! 


5.12 


5*29 


+ *17 


3.44 


6*?S 


+2*01 


3.26 


5.64 


4;;* 30 


4*11 


4*40 


+ *37 


4.34 

37?^ 


fOO 


41. Go 
4C»*21 


4*si 

JJn 


m 


41*10 

41,70 


m 




+ .60 
-4 .53 


5*59 


6.13 


4 *54 


5*17 


' i.lh 


4 *37 


6.07 


6.17 


+ *10 


S4l 


r^*17 


4 *76 


4*02 


S.7? 


4 ,05 


5.W 


6 .°i 


♦-.35 


54 50 


?05 




5*0'^ 




4 *71 


5.Pf 


6*10 


+ *22 


3.90 


4.09 


4 *59 




u.ao 


4 .74 


U.P8 


5*01 


+ *13 


4*Pl 


5.39 


► *5f 


4*17 


>».57 


4 *U0 


'♦.53 


4*46 


- *07 


4*94 


5.56 


4 *62 


3.90 


U.32 


4 .34 


5.3P 


5*42 


+ *04 


4*22 


5*06 


4 *ru 


4*Ij6 


5.07 


4 *61 


li.05 


4*62 


+ *57 


m 


4*^) 


4 .47 
TT52 


4*34 

UtoF 




4 .61 


Ji42 

51767 




4- *27 




5*4P- 












k.Ol 






m 






m 






i«.74 




4*lP 


4*P4 




4*04 


I*. 1*3 




<*.99 


5*07 




+* 


6G 






.39 




+, 


*08 




1 ST* 


















[ In the 


average for 


‘ factor 1. 
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Since the general tendency in both FT and ST schoole le toward increaied 
ratings over 1966, item differences showing decreases in ratings take on 
considerable significance. In this regard, two items are rather conspicuous 
in their decrease in both PT and ST schools. The first is the item ”behavioral 
standards of pupils,'* which showed the largest decrease in both PT and ST, and 
second "teacher absenteeism" which decreased .17 in PT schools while decreasing 
.36 in ST schools. Hot shown in the table but certainly of interest, is the 
fact that these two items decreased in both elementary and secondary level 

schools. 

It is interesting to observe that factor 9> Education Act, was assessed 
and understood to a higher exbent among PT administrators as compared to ST. 

The two items comprising factor 9 were given only in 1967* Both PT and ST 
rate "understanding of Education Act" considerably higher than "assessment of 
Education Act." ST, however, showed a much larger difference between under- 
standing and eussessment as compared to PT. 

Comparison with Other School Administrator Ratings . Columns 7> 8, and 
9 show the means and changes for "other" administrators in the school system. 
This classification is exclusive of PT and ST. Taking the average of all 
ratings, it ia seen that other administrators increase by .08 from I966 to 
1967 thus showing an Increase significantly lees than either PT or ST 
administrators. Decrease in morale by .14 parallels that for ST which in 
turn makes the increase, of .20 in PT more significant. This same. line of 
reasoning applies for virtually all factors where in terms of increase over 
1966, PT^T>other. 

Perhaps the most important factor difference in terms of 1967 means is 
the pupil-parent characteristics factor j where "other" admlnlstratora ’ ratings 
are over a full unit higher than those in PT or ST schools. The two items 
showing the largest decrease among "other" administrators were "school atten- 
dance of pupils" and "behavioral standards of pupils" scmewhat paralleling 



the finding among PT and ST administrators. 



Compar i s on vitli Teacher Ratings « Grand mean ratingn by all teachers over 
fi-ll items was lower in comparison to all three groups of administrators discussed 
above. In general, it appears that administrator ratings were higher than 
teachers on all factors except special education needs which administrators 
rated more poorly than teachers. 

Discussion 

The most significant finding of the administrator survey is the fact that 
administrators in PT schools showed higher ratings than those in ST schools, 
thus confirming the general hypothesis. Not only were mean ratings higher 
among PT administrators but also changes in ratings over I966 were higher. 
Comparing administrator with teacher ratings there is high correlation although 
administrator ratings tend to be higher and have more variability. This 
phenomenon may be a function of the smaller number of administrator ratings 
as compared to teacher ratings. Thus, the larger the number of ratings, the 
greater the tendency toward the mean of a rating scale. 

Comparison of PT and ST ratings with *'other** administrators shows that 
while the latter evaluations are generally hi^er on the various factors, 
the changes within both PT and ST are higher than "other. " As with the 
teacher survey, the crucial factor is pupil-parent characteristics. One 
might predict that increase in PT and ST ratings on other factors will result 
eventually in similar means. The big payoff will be shown when factor 3 
ratings parallel those in other schools. 
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CHAPTER 4 

RESUI/rS OF STUDENT SURVEY 

D escription 

A student survey consisting of twenty items was administered in May I966 
and a similar instrument consisting of twenty- five items was given in May 1967. 
All students in grades four through eleven in target and control schools and 
the suburban sample completed the survey anonymously. They were asked, however, 
to indicate the name of their school, grade level, and sex. The classroom 
teacher read directions to the students who were instructed to answer each item 
”yes" or "no." Answers were marked on the survey form and "scored" by Digitek. 
Non-public schools were included in the survey. This instrument was not 
administered below grade four because of the difficulty of such pupils reading 
the items. 

The 1967 student survey (K =25 items) contained eighteen identical items 
to the 1966 survey (K =20 items). Seven different items appeared on the I967 
form. The latter were designed to measure pupil self-image. 

Evidence of the reliability and validity of these instruments is lacking. 
Since they were given anonymously, test-retest reliability could not be 
ascertained. Internal types of reliability determination seem inappropriate 
since the survey measures several different types of factors. iiJhen time 
permits, concurrent validity studies of factors extracted from the survey to 
various school outputs will be conducted; e.g., school aspiration level and 
school achievement. 

Factor Analysis . Results ftrom the I966 survey were subjected to factor 
analysis. Intercorrelations among survey items were surprisingly low leading 
to a suspicion of considerable "noise" measurement. This may be explained in 
part, however, to the relatively low maximum correlation possible because of 
the distributions of p and q. In spite of this, the factor structures seemed 
quite reasonable. Factor analyses were made on both a sample of elementary 
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and secondary level pupils. For the most part, the factor structures were 
similar thus the results were synthesized.. The item clusters or factors 
are seen in table ?• 

Methods of Analysis 

Analysis was aimed primarily at response differences from I966 to I967 
in PT, ST, and C schools. In view of this, the major analysis was based on 
the eighteen items common to both years. The method was to employ a four-way 
analysis cf variance: year, I966, 19675 grade level , elementary 4-6 and 

secondary 7 - 9 ; school group , PT, ST, C; and items , eighteen items common to 
both 1966 and I967 surveys. The percents of affirmative response in this 
216 cell table were conv‘irted using the arc sine transformation upon which the 
analysis was "based. This was viewed as a mixed model with second and higher 
order interactions being used as error estimates. Providing school group by 
year interaction proved significant, it was planned to analyze item groupings 
(based on the factor analysis) by school group amd year using the chi square 
statistic. 

A second line of analysis centered around comparisons of responses between 
suburban and target school pupils using the chi square statistic. Similar 
analyses were made for specific comparisons such as sex and grade level trends. 
Results 

General . Tables 7 and 8 show the percents of affiimative responses for 
elementarjr and secondary level pupils to all I967 survey items and the I966 
results on the eighteen items common to both years. The latter are shown 
grouped as factors based on the I966 factor analysis. Inspection of the 
difference columns reveals differences of small magnitude; the bulk of them 
being within 3^* 

The analysis of variance revealed no significant difference either 
between 19£>6 and I967 or with the school group by year interaction. This 



>bl« 7 . Percents of Affim»tlve Responses to the Student Questlonnslre by Item, Fsctor, Year, and Group 



for ELiHEIfrARY SCHOOU. 












Group - 

Factor Year - 

ItSM > - 


•66 

(3307) 

(1) 


Primary Target 

•67 •6?-^66 

(3122) 

(2) (3) 


•66 

(6066) 

(4L_ 


Secondary Target 

•67 ’67- ^66 

(561.9) 




•66 

(814) 

_iZL- 


Control 

•67 

(690) 

^ 


•67- ’66 

-J22 


*67 

(p95) 


fSetor 1: VAiatCE TOWARD TEACHER 






















- Do yon need more help from 
your teacher? 


69.216 


69.216 


0 


66.P16 


67.216 


+ .4l6 


59.116 


56.4i 


- .Ti 


43.21( 


Factor 2: VAIENCE TOWARD SCHOOL 
«• Do you like school? 

- Do you like your school? 


85.2 

79.8 


87.4 

76.1 


+ 2.2 
- 1.7 


r?.6 

77.7 


83.2 

74.5 


+ .6 
- 3.2 


64.7 

81.1 


O/e — 

co.p 

84.8 


. m 0 

▼ XeU 

+ 3.7 


64.1 


- Would you like to spend more 
time in school? 


52.9 


51.9 


- 1.0 


45.7 


46.0 


+ .3 


39.5 


37.7 


- 1.8 


26.9 


• Do you look forward to coming 
to school each morning? 
FACTOR AVERAGE 


82.1 

75.0 


83.9 

75.3 


+ 1.8 
+ .3 


124 

tV* * 


S2ii 

71.0 


♦ .8 


72.0 


75.2 

71.1 


i>2i2 

+ 1.7 


63.5 

54to 


Fuc^or SCHOOL ANXIETY 






















• Are you satisfied with the 
grades on your report card? 


48.6 


47.9 


- .7 


49.3 


49.7 


+ .4 


CO 0 


51.0 


+ .1 


51.4 


- Do you worry about your 
school work? 


76.1 


79.3 


+ 1.2 


77.7 


76.8 


- .9 


72.1 


74.8 


+ 2.7 


67.8 


• Are you doing better In your 
school work this year? 


74.6 


71.8 


- 2.8 


71.7 


69.2 


- 2.5 


72.1 


71.7 


. .4 


73.7 


• Do you get praise at home 
for good school work? 
FACTOR AVERAGE 


82.1 


81.1 


- 1.0 


80.5 

7^. 


79.8 

68.9 


- .7 


83.1 

?9^ 


693 


zJL§. 

-a 


80.1 

ST! 


70.9 


70.0 


- .8 


- .9 


.3 


Factor 4: SCHOOL ASPIRATION 






















- Do you think you will 

graduate from high school? 

- Do you hope to go to college? 

FACTOR AVERAGE 


86.9 

^.3 

08.0 


66.3 

90.8 


- .6 


f 5.7 
88.2 


85.7 

89.4 

FtTS’ 


0 

+ 1.2 


87.5 

87.2 

WPi 


87.8 
68. 0 
FtTp 


+ .3 
♦ .8 


92.5 




FtTo. 


+ 1.2 






Factor 5; ATTIDIDE TOWARD FIEID TRIPS 
- Do you enjoy field trips? 97.3 


96.0 


+ .7 


95.1 


95.6 


+ .5 


94.4 


96.0 


+ 1.6 


95.4 


- Do field trips help you 
in school woric? 

FACTOR AVERAGE 


77.0 

8772 


77.6 


+ .6 


72.9 


70.9 


- 2.0 


72.7 


71.0 


- 1.7 


80.0 

WTi 


+ .7 


F5To 


- 


FisTS 


W5 


- .1 



Factor 6: PUPIL-PABEKT REIATIONSHIPS 

- Do you talk about school at 
home? 

• Has someone from home ever 

talked to your teachers? 

• Do you talk at home about 

what kind of jor or career 
you will have after you arc 
out of school? 

FACTOR AVERAGE 



Factor 7: AMOUNT OF READING 

• Do you read books from 
a library? 

- Do you read more than is 
required by your school 
work? 

FACTOR AVERAGE 



78.2 


81.6 


+ 3.4 


81.7 


60.3 


- 1.4 


80.0 


78.1 


- 1.9 


76. 5 


77.0 


- 1.5 


85.2 

cn 


85.~7 

■FliF 


+ .5 
+ .7 


84.2 

Fl3 


64.1 

FoT5 


- .1 
- 1.0 


83.6 


90.4 


+ 6.8 


64.2 


91.1 


+ 6.9 


72.5 


'64.6 

r^5 


+ 5.1 


60.3 

72.3 


57.6 

tO) 


- 2.7 
+ 2.1 



82.7 

78.5 



8U.7 

76.5 



+ 2.0 
- 2.0 



8U.3 

FTe 



8U.7 



* .u 

♦ .1 



72.9 



69.3 

6o 



♦16.4 
+ 5.4 



55.1 60.5 * 5.‘* 

64To 74.9 +10.9 



AVERAGE FOR 18 00»BH ITOe 
DHTEREHCES I967 - 1966 



77. 4^ ■ 79.0^ 



75.Tt 75. 5i 

- .2% 



72.9f> 75. 

+1.616 



Items on 1967 S urvey Only ; 



• Do you get along better 

outside of school than 
in school? 

- Do you think your teachers 

usually expect too much of you? 

- Do your teachers think you are 

doing well in yo\ir school voxM 

• Do your parents think you are 

doing veil in your school work? 

• Do you think you could do well in 

any school subject if you studied 
hard enough? 

- Are your lowest grades usually 

yo»:r teacher* s fault? 

• Do you think you could do well in 

any kind of Job you choose? 
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nctof 

Itmu 



Group - Prinstry Target 

Year - *66 *67 ’67-'66 

N - (2310) (2>»36) 

11) (2) (3) _ 



Factor 1: VAUWCE TOWARD TBVOHER 

• Do you need more help from 

your teacher? 

Factor 2: VAKNCB TOWARD SCHOOL 

- Do you like achooi? 

• Do you like your school? 

- Would you like to spend more 

time In school? 

• Do you look forward to comlnf^ 

to ochool each morning? 
FACTOR AVKRAGE 

Factor 3? SCHOOL ANXIETY 

- Are you satisfied with the 

grades on your report card? 

• Do you worry about your 

school work? 

- Arc you doinf^ better in your 

school work this year? 

- Do you get praise at home 

for good school work? 

FACTOR AVERAGE 

Factor 4: SCHOOL ASPIRATION 

• Do yon think you will 

grarluate from high school? 

- Do you hope to go to college? 

FACTOR AVERAGE 



60.'/% + 1-61 



r ( . A 

70.1 

lB.7 

65.0 

57.7 



34.8 
74.':' 

58.8 

66.9 



93.0 

83.*^ 



71.4 



Factor 5: ATTITUDE TOWARD FJEID TRIPf^ 

- Do you enjoy field trips? 05.4 

- ^ ' field trips help you 

1 school work? 76.5 

F.. TOR AVERAGE 86.0 

Factor 6: PUPIL-PARENT RRIATIONSllITS 

- Do you talk about school at 

home? 74.3 

- Has someone from home ever 

talked to your teachers? 61.0 

- Do you talk at home about 

what kind of job or career 
you will have after you are 
out of school? 84,6 

FACTOR AVERAGE 73-3 



Factor 7: AMOUNT OF READING 

- Do you read books from a 

library? 

- Do you read more than is 

required by your school 
work? 

FACTOR AVERAGE 



68.3 



44.7 



AVERAGE FOR l8 COWOK ITEMS 
DIFFERENCES 1967 • 1966 
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Itema on 196? Survey Only : 

- Do you get along better 

outside of school than 
in school? 

- Do you think your teachers 

usually expect too much of you? 

- Do your teachers think you are 

doing well in your school work? 

• Do your x>arcnti think you are 
doing well in jrour school work? 

- Do you think you could do well In 

any achool subject if you studied 
hard enough? 

« Art your lowest grades usually 
your teacher*! fault? 

- Do you think you could do well in 

any Kind of Job you choose? 
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70.3 
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66.0 
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60.5 

55.9 


62.8 
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43.6 


46.8 
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35.0 


+ .2 
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37.5 


+ 4.6 


33.7 


34.4 


+ .7 


33.6 1 
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'/?.('■ 


- 1.7 


'/H.O 


73.4 


- 4.6 


71.1 


71.7 


4 .6 


76.1 1 


59.3 


+ .5 


5f.5 


63.8 


+ 5.3 


56.? 


56.1 


- .1 


59.2 1 
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- .(> 
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59.1 
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+ .5 
+ 1.5 


60.7 
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5573 


4 2.2 
+ .9 


69.2 1 

59.5 1 
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9?. 3 
71.4 

fit: 


- .7 


03.4 

76.3 
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93.0 

75.8 

TOT 


+ .6 

r. 


90.0 

67.9 

79.0 


87.9 

52:2 

73.9 
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- 8.0 
• 5.1 


95.6 1 

61.1 1 


93.0 


- P.4 
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91.8 


- .8 


92. 8 
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- 3-0 


92.9 1 


73.r 


- 2.7 
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r.3.2 


70.5 

81.2 


- 1.1 


70.6 

ei.i 


68.2 

79.0 


- 2.4 

- 2.7 


71.1 1 

82.0 1 


■12.7 


- 1.6 


75.5 


75.'* 
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71.8 


72.2 


+ .4 
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comes as no surprise based on even casual inspection of the tables.* The 
percents of affirmative responses by school group and year are shown below. 



Year Difference Group 



School Group 
PT 


1966 


1967 


’67- '66 


Average 


72.5% 


11 M 




72 .(yf> 


ST 


70.9 


70.3 


- .6 


70.6 


C 


67.0 


67.4 


+.4 


67.2 


Year Average 


70.1 


69. S' 







The year average means are very close (.3^) and the difference column is highly 
similar showing no interaction. School group means, however, were significantly 
different (F=11.8, df 2,139) with PT=STXI. This result is similar to those 
obtained last year— thus no observable differences were detected. 

Factor Differences . Since the analysis of variance showed no significant 
difference in year or school group by year interaction, no further interpretation 
was considered. Of the total 42 factor average differences from one year to 
the next for PT, ST, and C, only two varied by more than 3^ at the elementary 
and 5 at the secondary level. Among elementary pupils there were increases 
in the reading factor, of 5-1^ in PT, 2.1^ in ST but ]0-9^ in C. Increases 
in target schools on the reading factor are understandable since these schools 
obtained libraries this past year. The significance of this rise is diminished, 
however, because C school pupils showed a 10.9^ rise in spite of the fact that 
no new libraries were introduced in these schools. V/hy this occurred is not 
known. Perhaps mere chance accounts for the changes, but unfortunately, we 
find a similar phenomenon occurring at the secondary level. The reading 
factor in PT decreased by ^. 2 $, ST decreased by 4.1^, while C increased 4.4^. 

We have no reasonable explanation.- 

Target and Suburban Differences . Unique to this I967 evaluation was 
measurement of suburban children on the student survey. While difference 

*Note that the analysic of variance was based on the data in both tables; i.e., 
elementary and secondary. 
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comparisons are not possible from 1966 to 1967> it is possible and enlightening 
to compare factor means for 1967 only between target School children and their 
suburban peers. 

Interestingly the factors which were significantly different were the 
same for the elementary as they were for the secondary comparisons and* in 
addition, were in the same direction. Four of the seven factors were signifi- 
cantly different between target and suburban pupils. The first was teacher 
valence, where fewer suburban pupils indicated they needed more teacher help 
in comparison to target pupils. The school valence factor also showed suburban 
pupils to have a lower school valence than target pupils. Finally, pupil 
aspiration and the reading factors both favored suburban pupils. 

While the remaining three showed no significant- difference as a whole, 
item means do show some revealing insights. Suburban children do seem to 
worry more about their school work, talk more about school at home, and 
j.ndicate their parents talk to their teachers more than target children. 

Comparison of the seven items which were included only on the 1967 
survey also reveals some interesting differences between suburban and target 
school pupils. In general, these seven items attempted to measure the self- 
image or self-confidence and ego strength of the students. Elementary target 
pupils indicated to a greater extent than suburban pupils that teachers expect 
too much of them* Ihis difference was not noted among secondary level pupils. 
On the two items pertaining to whether or not parents and teachers ’ think the 
pupil is doing well in school there is an interesting reversal. Elementary 
pupils in suburban schools believe both parents and teachers think they are 
doing well to a greater extent than elementary target school pupils. At the 
secondary level, however, a higher proportion of target school pupils believe 
that their parents and teachers think they are doing well in comparison to 
suburban pupils. One may infer that as suburban pupils reach secondary grades 
their self-confidence decreases somewhat perhaps reflecting greater parental 
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pressure on the need for academic excellence. Among target school pupils there 
seems to be more anxiety on this point in the elementary grades than there is 
in the secondary grades in contrast to suburban schools. 

The last three items shown in tables 7 and 8 reveal that over nine out of 
ten pupils in both suburban and target schools believe that they could do well 
in any school subject if only they studied hard enough. Assuming the validity 
of this item, the implications are extreme l^*- important. Thus, target and 
suburban pupils view their success in school primarily as a function of how 
hard they study rather than to other factors such as feelings of inferiority. 
While the largest proportion of both elementary and secondary pupils do not 
believe that low grades are the fault of their teacher, there does seem to be 
some tendency for a higher proportion of target school pupils (elementary and 
secondary) to believe this to be the case more than suburban pupils. Finally, 
it is noted that a significantly higher proportion of target school children 
think they could do well in any type of job they choose in comparison to 
suburban pupils. In short, there doesn’t seem to be any direct evidence of 
a lack of ego strength or self-confidence on the part of target school pupils 
at least in comparison with suburban pupils. Last year’s evaluation showed 
similar results when target school pupils were compared with control school 
pupils . 

Grade Level Differences . One of the most significant findings of last 
year-s evaluation was the fact that there was an apparent disenchantment with 
school as children progressed in the grades especially when they left the 
elementary school and entered the junior high school. This same phenomenon 
was confirmed in this year’s evaluation. Progressive disenchantment with 
school is most pronounced in comparing the school valence factor between 
elementary and secondary level pupils. This factor decreases about 20^ in 
affirmative responses from the elementary level to the secondary level. 
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Disenchantment is also revealed in parent interest and in certain items in the 
school anxiety factor » For example, whereas approximately one-half of elemen- 
tary grade pupils are satisfied with grades on their report cards, only one out 
of three are so satisfied at the secondary level. 

Sex Differences in Responses , As one might expect, the attitudes of girls 
differ considerably from those of boys relative to survey items. Of the twenty- 
five survey items, the percent of affirmative response was greater for girls 
than it was for boys on thirteen items while no significant difference was 
observed on eight items and th^’ee items show boys higher than girls. Girls, 
in general, responded more affirmatively to those items dealing with valence 
toward school, aspiration, amount of reading done, and teacher valence. Girls 
also showed, however, more anxiety toward school than did boys. 

On only three items did boys have a higher percent of affirmative response 
than girls. More boys than girls believe they got along better outside of 
school than in school, more thought that teachers expected too much of them, 
and more thought that low grades were usually their teacher’s fault. 

The factor dealing with field trips showed no significant difference 
between the sexes, Tne items dealing with doing well in school subjects if 
one studied hard enough and doing well in any kind of job that is chosen, 
shoved no differences among boys and girls. Figure 1 shows two rather impor- 
tant generalizations brought out in this chapter as reflected by responses to 
the q.uestion, ’’Would you like to spend more time in school?.” First, the 
figure shows that in both elementary and secondary schools, girls show a 
greater tendency tc want to spend more time in school than boys. Secondly, 
it shows that target school children have a higher valence toward school than 
suburban children. 

Discussion 



The data presented on the student survey do not support the hypothesis 
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that desirable changes in student attitudes would occur among target school 
pupils to a greater extent than control school pupils. The general finding 
was that of no significant difference in pupil response from I 966 to 1967> 
this being true in PT, ST, and C schools. The pupil responses in 1967> 
however) do continue to show a pattern of PT>ST>C. 

Perhaps the most interesting finding relative to the student survey 
were those comparisons of target school pupils with their suburban peers. 

In general, we found that target school pupils derive more satisfaction 
from school than do suburban pupils. Contrast in the desirability of home 
and school environment may account for this phenomenon. There was no evidence 
that the self-image and confidence of target school pupils was any less than 
that of suburban school pupils. In fact, there is some evidence to the 
contrary. In response to the items, "Do you think you could do well in any 
school subject if you studied hard enough?," and "Do you think you could do 
well in any kind of job you choose?," target schoo'*. pupils either equalled 
or surpassed suburban school pupils in their percent of affirmative response. 

On the other hand, those factors which are commonly thought of as distinguishing 
suburban from disadvantaged children were confirmed in these data. For example, 
there was confirmation that suburban pupils tended to have higher aspiration 
level, tend to read more, and tend to show more pai'ent interest than pupils 
in target schools. 

The differences observed between sexes and between grade levels come as 
no surprise and are well confirmed in previous investigation. Girls seem to 
enjoy school to a greater extent than boys and they seem to have a better 
adjustment to the demands of school than do boys. Boys tend to rationalize 
lack of success as being the fault of their teachers. 

The apparent better adjustment of elementary children versus secondary 
children to the school situation was confirmed in the results of last year’s 
student survey. Why this alienation phenomenon occurs as children progress 
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through the grades needs considerable study. Of great importance, however, 

is the fact that this phenomenon occurs with equal intensity with suburban p 

children as it does with target school ch: .dren, 

n 

u 

0 

D 

D 

□ 

D 

D 

D 

D 

D 

D 

D 

D 

D 







n 



f i 

ERIC 



41 



CHAPTER 5 

RESUITS OF PARENT SURVEY 

Description 

The Parent Survey, which was given in May 196?) consisted of an eighteen 

44>atv« 4 r\yy o 'na%»o/MnQ‘l *i >n+ Awr? ot.? Vioen e Q 7%Qri/^otm g.OTHT^l ^ 
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of twenty parents from each of the schools comprising PT, ST, and C. In 
addition, it was administered to the suburhan school sample. The sample was 
drawn from pupil censiis cards arranged by school. Every nth pupil was 
selected to obtain the sample of twenty per school. Parents of the pupils 
selected in target schools were interviewed by parent aides in the ESEA 
program; control and suburban school parents were intervievred by PTA volunteers. 
All interviewers were given an afternoon of training and instruction in giving 
the survey. Of the 1,080 parents sampled, there were 1,017 returns or 94^* 

It is important to note that the parents taking the survey were not 
necessarily parents of pupils receiving service in the Education Act program. 
The \iniver??e of parents sampled was all parents living in the schools sampled 
who have children in school — either public or private school. While the 
likelihood of observing significant differences in responses from one year 
to the next with target and control area parents was deemed slight, it was 
nevertheless thought important as continuing baseline data. It is conceivable, 
in other words, that some day the ESEA program may show measurable ei.:ects on 
parents. It is worthy of note that the s\irvey items did not connect the 
interview with the Education Act program in any identifiable way. Thus, the 
parents reacted to general questions about their child* s education and not 
to the worthwhileness of the ESEA program, per se. It was believed that an 
undesirable Hawthorne effect would be created If the parents were asked to 
react directly to the effectiveness of ESEA^ 

One of the limitations of this approach was uhat the surveys were not 



administered to an identifiable sample of parents whose children were 
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receiving ESEA services. Next year (spring, I968) a subsample of parents of 
children in the ESEA. program will be surveyed in addition to the type of 
sample herein defined. 

In both the I966 and I967 surveys the parents were read the items on the 
survey and ■ sked to respond in an affirmative or negative manner to each 
question. Tne interviewer simply marked on the survey form "yss” or "no” in 
response to each question. The survey forms were scored by Digitek and scored 
in terms of percent of affirmative responses by item and type of school. 

The 1966 and I967 parent surveys contained eleven items in common thus 
leaving seven items unique to the 1967 survey. Analysis of change from 1966 
to 1967 was made only for these eleven common items and only across FT, ST, 

a 

and C since the survey was not given to the suburban school sample in 1966. 

Factor Analysis . Factor analysis of the ,1966 survey form was made. As 
with the student survey, ’tern intercorrelations were surprisingly low thus 
leading to the suspicion that more noise measurement than signal measurement 
was being made. It is highly probable, however, that the low intercorrelations 
were at least in part a function of the typically high percentage of affirma- 
tive responses to items. This situation produces an artificially low ceiling 
on correlation.* In spite of the low inter correlations, the factor structure 
of the survey seemed to yield fairly reasonable results. The item clusters 
or factors of the eleven items common to both ^ears will be seen later in 
summary form. 

Methods of Analysis 

Analysis of data was focused on change from I966 to I967 for the eleven 
common items among PT, ST, and C. Two general procedures were employed. 

*Maximum phi coefficients per item by year tended to be in the low eighties. 



i 



D 

D 

n 

u 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 




First, data were analyzed in a four-way analysis of variance design. The 
factors analyzed werei years , I966 versus 19675 level , grade level (K- 3 ? 

4 - 6 , 7-11) at which parent’s child was attending; school group, , FT, ST, or 
A cioiroM 4 +.PTnsi rrmimon to the suTvevs ffiven in 1966 and 19^7 • 

The percentage of affirmative responses in this I98 cell table were converted 
using the arc sine transformation as described by Snedecor^. The latter 
transformations were used in the analysis of variance. The major interest 
in this analysis was, of course, the school group by year interaction. The 
analysis of variance was considered as a mixed model vrith items being con- 
sidered a random factor and groups, year, and level being considered fixed. 

Secondly, factors identified tlirough the factor analysis were scored 
in terms of percent "yes" and "no" by school group and year. This procedure 
led to a twelve cell contingency table to which the chi square statistic was 
applied. This latter procedure was seen as a compliment to the analysis of 

variance. 

Finally, survey items unique to the I967 survey were simply compared 
across PT, ST, and C and S using the chi square statistic to determine 
significance of difference. 

Results 

General. Table 9 shows the percents of affirmative responses made to 
1967 survey items and to the eleven items common to both years which are 
shown grouped as factors based on the factor analysis. Parent classifi- 
cation by grade level of their children is not shown because analysis 
showed no significant difference among levels. Of the 33 comparisons 
within PT, ST, and C from I966 to 19 ^ 7 > it is noted that all eleven from 
PT show a decline; nine of the eleven in ST show decline; and ten of the 



^Snedecor, George, Statistical Methods . Ames, Iowa; Iowa State College 
Press, 19 ? 7 , PP. 31 » & 319 - 
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- 6.6 


79.5 


U3.8 

53TB 


27.3 

5^ 


-16.5 

-12.8 




22i2 

57.0 


- U.8 

- 1.1 


22.0 


20.3 

roi7 




61T3 


e« 0* 


77.8* 




85.2* 


81.5* 




78.1* 


73.5* 




75.3* 



-lo.sl, - 3 . 7 % -'*.6% 



teas on 196? Survey Only : 



- Has studied harder this 

year than last year? 


71.9* 


74. 1* 


72.5* 


73.9* 


- Do you think will finish 

hl^ school? 


94.3 


96.0 


94.5 


99.5 


- Go you think will go 

to college? 


U9.U 


62.6 


53.2 


87.7 


- Does get along well with 

other students In school? 


96.1 


96.3 


95.7 


98.7 


- Do you approve of * s 

friends? 


90.9 


93.6 


91.0 


96.7 


• Has 's health been better 

this year than last year? 


76.6 


73.7 


69.5 


64.5 


- Have you talked to the school 
nurse about ? 


12.9 


15.7 


10.7 


7.8 



[a) It«as in 1966 survey^ which were^^t repeated In I967 survey are not reported^ 
lb) Survey not given In suburban schools In 1966* 

[c) the Interviewer Inserted the child's name In the blan)c spaces as the question was read. 
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eleven in C show a decline. On the average, PT parents show a decline of 10.2^ 
while ST and C parents decline 3*7^ and 4-. 6^, respectively, from 1966 to 1967. 

The analysis of variance confirmed a significant decline from 1966 to 1967 
(F*S?0.3> df l,l46) but also confirmed the obvious interaction of school group 
by year (Fs 5.4, df 2,146). Thus, decline in affirmative responses among PT 
pcrents was significantly greater than the decline among ST and C parents. 

Factor Differences . To obtain an idea where item decline from 1966 to 
1967 was significantly different among PT, ST, and C, items were grouped on the 
basis; of the I966 factor analysis. These groupings are shown in table 9. The 
first three factors account for most of the variance in the factor analysis and 
are most directly related to pupil school performance. No significant difference 
was shown in decline of the latter three factors among PT, ST, and C. 

Factors 4, 5, and 6 were significantly different among PT, ST, and C. 

In response to factor 4 (Are teacher and principal interested in your 
child?), C parents showed an increase of 11.2%, ST an increase of 2.1%, and 
PT a decline of 4.1% in affirmative response from 1966 to I967. For factors 
5 and 6, pupil-parent relation and school involvement, both ST and C declined 
sli^tly while PT declined much more. 

Of importance, however, is the fact that in spite of large FT declines 
in factors 4, 5, and 6, the percents of affirmative responses in 196? are 
about the same among PT, ST, and C parents. Thus, the large decline in PT 
probably is a function of their hi^er percents in I966 compared with ST 
and C. 

Target and Suburban Differences . How do suburban parent responses 
differ and how are they similar to target school parents? To answer this 
question, PT and ST parents were combined and compared with S parents for 
each item in 1967 only using the chi square test. The following items 
showed significantly higher affirmative response: 












iMMwnMHti^ 



46 



Sutoban Parents Significantly Higher in ^ Yes 

- Is improving in school work? 

- Does study at home? 

- Do you think will finish high school? 

- Do you think will go to college? (very large difference) 

« Are you in any way active in school? (large difference) 

T\^ mw^'% « r\"f* 

«• V V<- wx 



’ e» -Py**? ort<^c9 

w ^ «k WW • 



Target School Parents Significantly Higher in ^ Yes 

- Has the school helped you do more things with ^? 

- Would you like to know more about 's school? 

- Has ‘s health been better this year than last year? 

It appears that many of our traditional notions of parent differences from 
target area to suburb are substantiated. Suburban parents have higher aspiration 
levels f j-r their children, are optimistic and involve themselves in the school. 
Schools seM to be more important to target area parents but for various reasons, 
perhaps economic and social, they are more alienated in terms of involvement. 

Sex Differences in Responses . Of the 1,01? parents surveyed in I 967 , 100 
were men and 91? were women. Were there differences in their responses to the 
survey items? Univariate analyses showed few items where men’s responses differed 
significantly from those of women. Where differences occurred, women responded 
in a more affirmative manner than men. In no instance was there an exception. 
Following are the items on which significant difference appeared: 

Women Significantly Higher than Men in ^ Yes 

- Have you talked to the school nuirse about 

- Do you think will go to college? 

- Are you in any way active in school? 

The traditional role of the mother in our society probably accounts for 
the differences in the first and third items above. Expectation that children 
will go to college is less among men than women parents. What effect does this 
have upon boys? Is this an expression of a more realistic attitude? Which 
attitude should prevail? 

Discussion 

The parent survey represents an attempt to measure parent attitudes and 
5 ir perceptions of their relations with their children, the school, and 
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education in general. Certainly the instrument will respond to many factors 
other than Education Act especially with the type of random sample used. Since 
the Education Act program was never mentioned in connection with the survey, it 
is doubtful that the systematically lower ratings were a function of dissatis- 
faction with Education Act. Further, it was noted that a decline in parent 
response was noted among parents in control schools as well as target schools. 
The largest decline among parents in PT schools appears to be a function of 
their very high ratings in 1966 rather than low ratings in 1967* Parent 
responses among PT, ST, and C schools seemed to be about the same in 1967* 

Results obtained from suburban parents did confirm some of the differences 
that are thought to distinguish middle class parents from parents of poverty. 

Next year a few items will be added to the survey which will be aimed 
directly at measuring parent attitudes and knowledge of the Education Act 
program. These items will be put at the end of the survey so as not to bias 
responses to previous items. Further, next year's survey will include a 
subsample of parents whose children are directly engaged in Education Act 
services. 

The parent survey detected no significant positive change nor did it 
reveal any significant negative change with respect to the Education Act 
program. The general decline noted from 1966 to 1967 probably was a function 
of general factors not associated with Education Act. The fact that Cincinnati 
experienced riots in June, one month after these surveys were administered^ may 
have no connection with the general decline of affirmative responses but the 



association should at least be mentioned. 
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CHAPTER 6 

PUPIL ACADEMIC ACHIEVEMENT 

Description 

A standardized achievement testing program was conducted during the year 

to measure the effects of the various services upon pupil academic achievement. 

In contrast to the achievement testing program conducted last year (1966) when 

all punils in grades 2 through 10 in target and control schools were tested, 

this year's testing program was not as extensive. The ESEA testing program 

was conducted in conjunction with the system-wide testing program; the latter 

receiving priority relative to time of testing, type, and form of test. Where 

possible, results of the regular testing program were used for this evaluation. 

The test battery and form given at each grade level are shown below; 

Standardized Achievement Tests 
Given by Grade Level 

Grade Level Test Used 



£ Stanford Primary I, Form W 

4 Stanford Intermediate I, Form X 

5* Stanford Intermediate I, Form W 

5 * Stanford Intermediate II, Form Y 

7 Stanford Advanced, Form X 

10 Stanford Advanced, Form W 



*Regular city-wide testing program. 

As seen above, grades 3 , 8, and 9 were not tested. The Stanford Achieve- 
ment tests, based on local expert Judgment, have good curricular validity in 
relation to our program. Their norms, however, are extremely demanding 
especially for the target school population. There is an approximate ten 
point difference in I.Q. between the test norm group and the city-wide median 
and a twenty point difference in PT schools in Cincinnati. In spite of this, 
the Stanford tests were used again this year in order to afford comparability 
from year to year. Further, our concern is more on achievement increase than 
it is on achievement status per se in relation to national norms. 

o The Metropolitan Achievement test which was used in grade 2 last year 

ERIC 



(1966) was replaced uj- the Stanford tests used during the current year. This 
was done for the sake of consistency in expected longitudinal measurements 
over the next few years* The much lower grade 2 results using the Stanford 
in comparison to the Metropolitan tests attests to the demanding norms of 
the Stanford. It should also serve as a warning to other investigators of 
being very cautious in comparing grade scores from one test to another and 
even one test form to an alternate form. 

Other changes in the testing program were made. Certain subtests such 
as science and soci*3il studies which were given in 1966 were not repeated in 
1967. Further, grade 10 pupils were given the Stanford Advanced battery 
this year rather than the High School battery given in I966. The Advanced 
battery is more appropriate in terms of difficulty level and other charac- 
teristics for this population of pupils. 

The tests were administered by teachers within a stipulated two week 
period at the end of May in grades 2, 4, 7 and 10. Tests were given in grades 
5 and 6 at mid-year because they were part of the regular testing program. All 
tests were machine scored. The tests were administered only to pupils in 
regular classes thus excluding pupils in slow learning classes, classes for the 
blind and deaf, and special classes for the physically and emotionally handi- 
capped children. 

Methods of Analysis 

Distributions of grade scores for each grade and subtest ware made for 
primary target, secondary target, and control schools. From these distri- 
butions, quartile points were determined. This total procedure has been 
programmed on data processing equip::.3nt. 

Analytic procedures involving tests of significance were not applied. 
Literally thousands of pupils were tested thus making standard error statistics 
extremely small. Due to the practice of rounding grade scores to the nearest 
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month, it was felt that comparisons which were different hy only plus or minus 
one month should be ignored. 



Because of the changes in tests used £uid grades tested, direct comparison 



10^7 Y*Aenl*hc t»rn *hVl *So mor^o •? )i r\^A ^ 

I A v« «•«. W** ww MVIWO *T , CHXVi ( . 



Results 



A summary of the 196? achievement testing program* is seen in table 10. 

In general, the results are highly similar to those obtained last year; The 
overall pattern at all quartile points is the same as in 1966. In- 

spection of the battery medians reveals PT and ST more similar than ST and C. 
The spelling, arithmetic computation, and arithmetic concepts subtests continue 
to show the highest relative achievement while the language subtest continues 



to shew the lowest achievement level. Of interest is the fact that arithmetic 



computation achievement is higher than arithmetic concepts in the elementary 
grades but a reversal occurs in the secondary grades. This same phenomenon 
occurred last year and may reflect curricular emphasis from elementary to 
secondary schools. 



Other results which parallel those found last year are as follows: 

1 . 



There is a cumulative deficit in achievement as defined by 
increasing deviation from norm with age-grade level. 



The distribution of scores within a grade for PT, ST, and 
C generally shows a wider range of scores between Q2 
Qo in comparison to and Q2. Thus, distributions are 
skewed positively. 



There is a tendency for the range of grade scores between 
and Qg (and Qg Q3) increase with age-grade level; this 
reflecting increased range of achievement at higher grades. 



Comparison of Grade Scores in I967 to 1966 . Of the six grade levels 
tested both years, three are subject to reasonably good comparison while 



o 

ERIC 



*For comparable summary of the I966 test results, the reader is referred to 
the Jo\irnal of Instructional Research and Program Development , Volume 2, 

Number 1, October, I966, pp. 40-43, Cincinnati Public Schools. 



Table 10. Summary of Standardized Achievement Test Grade Scores by Grade, Subtest, and Type of School. 
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three are not. Different tests were used in grade 2 and there is a great 
difference in norms between the Metropolitan and. Stanford tests $ the latter 
being more demanding according to the Staniord Technical Supplsmsnt . This 
was borne out by local results whiah showed about two months "lower” achieve- 
ment in 1967 as compared to I966. Taking into consideration the differences 
in norming of the two tests, it is believed that second grade achievement 

probably was the same in 19^7 as in 1966. 

Grade 5 tests were not comparab.le because tests were administered during 
different times of the year; i.e., May I966 vs. February I96/. The three 
month difference makes it tenuous to compa^re results even with a norm adjust- 
ment since these pupils do not normally increase one month of achievement 
for one month of school. 

Tenth grade results are not comparable because different batteries were 
used; i.e., the Hi^ School battery in I966 and the Advanced battery in 1967. 

The test results from three grade levels were subject to comparison with 
last year’s results. In grades 4, 6, and 7 the same or parallel form of the 
test was used and the time of testing was nearly the same in 29^7 as it was 
in 1966. In making comparisons of achievement at a given grade level from 
one year to the next, it must be recognized that two different populations 
are being compared. Confidence in making such comparisons depends on the 
similarity of the two populations on non- achievement type factors. Unfor- 
tunately, we have no way of assessing possible differences in the populat^-on 
and we must assume they are essentially the same from one year to the next. 

Table 11 summarizes achievement differences from I966 to I967 for grades 
4, 6, and 7. 

In the fourth grade, of the 30 quartile points represented in the five 
tests for FT and ST, 22 were identical; 3 (all in FT) were one month higher, 
and 5 were one month lower in 19^7 compared to 1966. One may conclude 
that fourth grade achievement in target schools remained essentially the same. 
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In the control schools, however, there were increases in 13 of the 15 quartile 
points. The increases ranged from one month to nine months with a median 
increase of four months. It is likely that the latter increases are due to 
different populations; this being more plausible with the small number (N=244) 
of fourth grade children in C schools. 

Table 11. Months of Achievement Difference at Quartile Points from I 966 to 
1967 hy School Group, Subtest, and Grade Level. 



Grade Level 
Subtest 


Primary 

Target 

Q2 ^3 


Secondary 

Target 

% Q2 ^3 


Control 
Ql Q2 ^3 


FOURTH GRADE 




















Word Meaning 


0 


0 


0 


0 


0 


0 


0 


0 


+7 


Paragraph Meaning 


0 


+1 


0 


0 


0 


0 


42 


42 


+5 


Language 


0 


0 


-1 


0 


0 


0 


42 


44 


+9 


Arithmetic Computation 


0 


-1 


0 


-1 


-1 


-1 


+3 


41 


44 


Arithmetic Concepts 


+1 


0 


41 


0 


0 


0 


+3 


44 


46 


SIXTH GRADE* 




















Word Meaning 


+1 


~1 


-1 


0 


0 


41 


-*• 


-^l 


+3 


Paragraph Meaning 


+2 


-1 


-3 


42 


0 


-1 


0 


-3 


-3 


Spelling 


0 


-2 


-3 


-1 


-1 


0 


-1 


41 


41 


Language 


0 


-2 


-2 


0 


-2 


42 


42 


42 


41 


Arithmetic Computation 


-1 


+1 


-1 


-1 


-2 


-2 


-4 


-7 


-18 


Arithmetic Concepts 


+1 


0 


41 


0 


42 


42 


+3 


-2 


-11 


Arithmetic Application 


0 


-2 


-3 


-1 


-2 


41 


-1 


-5 


-5 


SEVENTH GRADE 




















Paragraph Meaning 


-1 


-2 


- 1 - 


-2 


-1 


41 


-4 


-3 


-6 


Spelling 


46 


46 


48 


44 


42 


45 


42 


41 


+5 


Language 


-5 


-1 


0 


-6 


-2 


42 


-6 


-6 


-2 


Arithmetic Computation 


+1 


0 


-1 


0 


-1 


0 


-1 


-2 


-6 


Arithmetic Concepts 

Jt ^ _ 1 ^ _ _ 


+1 


41 


44 


41 

1 # f i 


+3 


46 


0 


46 


46 



*A one month adjustment was made for comparability to account for the one 
month difference in testing time. 



Comparison in grade 6 cannot be made without adjustment because in I 967 
the battery was given one month earlier than last year and a different form 
of the Stanford test was given. In spite of the forms (X in I 966 and W in 
1967 ) being "equivalent,” equal raw scores often yield different grade scores. 
Nevertheless, by adding one month to the I 967 grade scores to adjust for the 
one month difference in testing time, reasonably good comparisons can be made. 








Of the 63 quartile points compared in FT. ST, and C for all seven subtests, 
increases over I966 are shown in 19j five in PT, six in ST, and 8 in C. 

The predominant pattern, however, is one of decrease from one to three months 
but this is seen to occur the same in PT and ST. Decreases in the arithmetic 
achievement in C schools are rather large particularly at Qg ^3* Such 
large decreases can only be explained reasonably through a change in pupil 
population characteristics. 

The I.Q.’s of the sixth grade groups were obtained in the regular testing 
program. It is of interest to note these aptitude scores as further indicators 
of differences among PT, ST, and C and also as an aid in interpreting academic 



achievement. 

Table 12. I.Q. Quartile Points of Sixth Grade Pupils as Measured by the 
Lorge-Thorndike Verbal Ability Tests for PT, ST, and C in I967. 



School 

Group 




Quart! le Points 
Ql Q2 ^3 


PT 




80.19 


S 8 . 7 k 


96.64 


ST 




81.5^ 


90.53 


100.79 


C 




84.50 


95.25 


106.90 



In the seventh grade the general pattern of change is mixed with 20 
increases, 20 decreases, and 5 no change in quartile points. Increases 
and decreases are about equally divided among PT, ST, and C. Spelling 
increased most in general but primarily in PT. Arithmetic Concepts increased 
second most while language showed the greatest decline. 

Other analyses of achievement change were made by comparing one grade 
in 1966 with the succeeding grade in I967. The advantage is that we are 
dealing with essentially the same pupils from one year to the next except 
for failures or pupils who move. Based on the finding last year that target 
school pupils generally increase at the rate of about 6.5 months per 10 month 
school year,* it was found that this rate did not change. 

*This rate was based on cross-sectional data in I966 while the comparison was 
made with rates based on "longitudinal data." It is assumed they are similar. 



Discussion 
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The test results in 196? parallel those in I966 to a very great extent 
both in terms of overall achievement by grade and in tenns of relative subtest 
strengths and weaknesses. If there is any single academic achievement target 
goal of the ESEA program, it is to increase the average rate of achievement 
growth significantly above the currently normal 6.5 months per 10 month 
school year. 

The target pu pils within the target schools are distributed within the 
lowest quarter (under the point) of the results of this section. When the 
cumulative effects of the ESEA. program start affecting academic achievement, 
should be the first to show the change. 

Perhaps the most important criterion in measuring the success of the 
ESEA program is pupil academic achievement. Yet this criterion is the most 
stubborn to increase and maintain. It will probably take years of concen- 
trated effort starting in preschool years to significantly increase achieve- 
ment. It should be remembered, however, that these results reflect school- 
wide achievement and the large majority of pupils in a school received no 
direct service of an intensive nature from the ESEA staff. It would have 
been strange and even suspect had average school achievement increased. 
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CHAPTER 7 
PUPIL ATTENDANCE 



Description 

Absence rates are best expressed in terms of the percentage of pupils on 
the rolls of a given school who are recorded absent each day. Thus, to report 
the absence of a group of schools for one year is to give the ratio of average 
daily absence to average daily membership within these schools for that period. 

The data in this report were compiled irrespective of reasons for pupil 
absence. In the first place, it is extremely difficult to arrive at an objec- 
tive basis for distinguishing legal from illegal absence. Secondly, it is 
obvious that many pupils who might have valid reasons to be absent from school 
manage to attend nevertheless because they are sufficiently motivated not to 
want to miss the activities of a school day. Such motivation seems a desirable 
goal in trying to improve the educational program of disadvantaged youngsters. 

The regularity of attendance, then, is seen as a reasonable index of a 
pupil’s interest in school. Whether he attends seems to be a much more 
reliable measure of the meaning that the school experience has for him than 
whether he says that he likes school. If Education Act services produce 
favorable changes in attendance patterns, it is reasonable to conclude that 
these services have added new meaning to the education of disadvantaged pupils. 
Method of Analysis 

This report continues the comparison of absence rates in primary target, 
secondary target, and control schools that was begun in last year’s program 
evaluation report. The chief focus is on changes that may have occurred in 
primary target schools since the initiation of Title I services. Secondary 
target schools, having received few services, are not expected to show 
significant gains. The control group is retained for comparison purposes. 

The baseline established last year for the school years I96O-61 through 
1964-65 will be used in this comparison. Date for I965-66, representing a 





i 1 











□ 

D 

□ 




V 




partial year of Education Act, -will be reported separately. The comparison 
of this year's absence rates with those of the baseline period will show 
whether target school absence rsTtes have changed favorably in comparison to 
control rates. 

Results 

Absence rates by grade in primary target, secondary target, and control 
schools for the five-year baseline period and for the school years 1965-66 
and 1966-67 are shown in table I3. This table makes it possible to compare 
changes in absence rates in grades one through nine under the Education Act 
in target schools with changes that have occurred in control schools where 
no Education Act services were received. 

Inspection of table 13 reveals the following facts : 

1. In all grades in the primary target schools, except grade two, 
absence rates increased from the five, base years to 1965-66 
to 1966-67* 

2. In the junior high grades 7? 8, and 9, the absence rate pattern 
is PT^T>C. Absence is increasing each year not only in PT but 
also in ST and C secondary schools. The rate of increase of 
absence in secondary grades is greater than in elementary grades 
in primary target schools. 

3. Comparison of absence rates in elementary grades amoi-g FT, ST, 
and C are much more similar than for secondary grades. Never- 
theless, PT absence in grades 1 to 6 is both greater than and 
increasing more than either ST or C. 

4-. Viewed from grade to grade, absence rates in all schools tend 

to decrease from grade 1 through grade 3, to rise again in grades 
4- through 6, and to jump sharply at grade 7 and to be somewhat 
higher at grade 9* Primary target rates, especially at the 
secondary level are highest, For I966-67 the control school 
rates tend to be somewhat higher than those of the secondary 
target schools. 

Discussion 

There are many factors that affect the rate of pupil absence from school. 
As one looks for causes that might have had a widespread effect in the schools 
included in this study, two conditions stand out. First, the weather, particu- 
larly during the winter months, was comparatively mild. This fact, plus the 



Table I 3 . Percents of Average Daily Absence by Grade for Primary Target, Secondary Target, and Control Schools 
for Five-Year Baseline Period, 1965-66, and 1966-67* 
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absence of serious epidemics, might account for the stability of absence rates 
in control schools and the decrease in the secondary target schools. The con- 
current increase at the primary target level is. difficult to explain. The 
largest jumps in rate of absence occurred in grades 1 and 6; in each case the 
rate for I966-67 was one per cent higher than for the preceding year and for 
the five-year baseline period. 

The increase is also fairly evenly divided over all of the schools in 
the primary target area. It is possible that this highly transient area 
includes an increasingly larger percentage of families who value education 
less, for whom the slightest reason is adequate to justify the pupil’s staying 
home. 

Tliere is, however, another factor that might be pertinent, particularly 
at the sixth grade level. It should be noted that even in secondary target 
and control schools the sixth grade rates increased sli^tly for the most 
recent year. Thus, it may be generalized that older pupils were absent from 
school more in I966-67 than in the preceding year. This fact is probably 
traceable in part to the local civil rights disturbances which took place 
in the areas served by the schools included in this study. A number of 
expressions of concern were received by the schools indicating that parents 
had kept pupils home out of fear for their safety 

The essential question to be answered in this study, however, was 
whether evidence would indicate lower absence rates in the target schools. 

On the basis of the evidence gathered, it must be concluded that no such 
effects have occurred. Whether continued ESEA services might eventually 
bring about an increase in pupil and parent motivation and improvement in 
physical health, which will cause the absence rates to decrease, can onljr 
be a matter of conjecture. 
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CHAPTER 8 
PROMOTION RATES 

Description 

Promotion rate is typically expressed ts the quotient resulting from the 
ratio of the number of pupils advanced to the end-of-year membership. It is, 
in other words, the percentage of pupils finishing a school year who are 
advanced to the next grade. In the Cincinnati Public Schools a pupil is either 
advanced or retained for a full year’s work in the elementary grades. Promotion 
at the secondary level, on the other hand, is by subject, with the grade place- 
ment designation determined by the number of subjects passed or credits earned. 
For example, it is possible for a pupil in the tenth grade to be taking some 
subjects at the ninth grade level. 

The use of promotion rates as an index of effectiveness of a program is 
based upon several assimiptions concerning their reliability and validity. 
Obviously, there must be some consistency of standards from school to school, 
grade to grade, and year to year if meaningful comparisons are to be made. 

If promotion criteria are either more or less rigid one yea,r than they were 
the preceding year, the comparison must take this into account. It is also 
necessary to assume that promotion rates are valid indicators; i.e., that the 
standards for promotion generally correspond to the objectives of the program 
being evaluated and that teacher judgments about pupils' readiness for pro- 
motion are reasonably accurate. 

Method of Analysis 

This report continues the analysis of promotion rates in the 1965“66 
Title I program evaluation report. Last year’s report established baseline 
data in the form of composite promotion rates for the five-year period from 
1960-61 through 1964-65, as well as the rates for the I965-66 school year. 

These rates were determined by grade for primary target, secondary target, 
and control schools. 



o 
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In this report the I966-67 promotion rates for tne same school groupings 
are compared by grade to those of the preceding years. Last year's rates are 
kept separate because they represent a partial year of ESEA services. The 
1966-67 rates, of course, are representative of the first full year of Title I. 

It should be noted that one secondary target elementary school which 
qualified for ESEA services in I965-66 but not in I966-67 has not been included 
in the data for the most recent year. The percentages of promotion in this 
school, however, vary only slightly from the total percentages for secondary 
target elementary schools. In addition, one of last year's control junior 
high schools is lio XongCjT operating. A new junior high school with a similar 
population has been included in the figures for grades 7> 8, and 9* 

Results 

Table l4 showing the percentage of pupils advanced at each grade level 
in primary target, secondary target, and control schools, makes it possible 
to compare piomotion rates for the most recent year with earlier data. In 
grades K through 9 changes in promotion rates under the Education Act in 
target schools may be compared with changes that have occurred in control 
schools, where no Education Act services were received. The average promotion 
rates for grades K through 9 are shown at the bottom of table l4. This kind 
of comparison makes it clear that there has been a general tendency toward 
higher promotion in all elementary and jtinior high schools represented. In 
grades 1 through 9> only two of the I966-67 percentages in table l4 (grade 1, 
PT, and grade 9? ST) are lower than the corresponding rates for the baseline 
years. All others show an increase ranging from .2 to 3*6 per cent. 

The increase in promotion rates for 1966-67 as compared to the baseline 
period is greatest foli^the control schools, averaging 1.7 per cent per grade. 
Primary target schools show an average increase of 1.4 per cent per grade, and 
secondary target schools, 1.2 per cent. Thus, there appears to be little or 
no connection between the increased promotion and Education Act services. 



Table ih. Percentages of Pupils Promoted in Primary Target, Secondary Target, and Control Schools by Grade 
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Compared to the I965-66 rates, the percentages for the most recent year 
represent an average increase for the secondary'’ target schools of 1.6 per cent 
per grade. This may he viewed as a recovery from the low promotion percentages 
of the preceding year. The changes in primary target and control schools are 
negligible (+.1 per cent, primary target and -.4 per cent, control). 

For the one primary target senior high school no comparison with a 
control group is possible. It will be noted, however, that there has been 
a general decline in the promotion rates of this school. 

Viewed from grade to grade, the promotion figures tend to follow the 
pattern noted last year, rising from a low at first grade level through each 
of the five succeeding elementary grades. Interestingly, however, the rates 
for grade 3 rose more sharply than any other in I966-67 to distort this 
perennial pattern somewhat. . The junior high school pattern also is less 
consistent than in previous years, with rather small differences evident 
from one junior high school grade to another. 

The promotion rates for I966-67 remain highest in the control schools. 

For ei^t of the ten grades where comparisons can be made, secondary target 
rates are higher than those of primary target schools. Thus, it may be 
generalized that the promotion rates for the first full year of Education Act 
services follow rather closely the pattern suggested by the basis for selection 
of the three categories of schools; i.e., 

Discussion 

The general increase in promotion rates in the elementary and junior high 
schools included in this study is subject to various interpretations. Basically, 
one mi^t contend either that more learning is taking place, so that fewer pupils 
are failing to reach the minimum standard for advancement, or that the standards 
are becoming less rigid from year to year. Some assistance in interpreting the 
increase is provided by the comparison of achievement test scores reported in 
an earlier chapter. An examination of scores at the lowest percentile points 
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suggeats that these pupils are indeed learning more; grade scores at the tenth 

percentile shov general increases over last year. 

Within the range of these two interpretations, however, there are several 
other questions that need to be answered. First, if promotion standards are 
r^oriRt.ant and nunils are learning raore, why is this so? The larger 
increases in the promotion rates of control schools suggest that this phenomenon 
is unrelated to Education Act services. And yet, recognizing that all three 
levels of schools included in this study have substantial percentages of under- 
privileged children, one might wonder whether ':he educational profession is 
becoming more knowledgeable about the underprivileged child and more under- 
standing of his needs. If increased understanding of the special needs of 
the disadvantaged is a causative factor in increased promotion rates, certainly 
the Education Act may he viewed globally as enhancing this effect. This 
hypothesis is negated, however, hy the general rise in city-wide promotion 

percentages, particularly at the elementary level. 

It may be, in fact, that teachers and administrators are lowering their 
standards for promotion, even without being aware that this is the case. This 
phenomenon seems more likely in target schools. A study by Jacobs produced 
evidence of a dual standard of promotion in basin and suburban schools. Even 
though all personnel involved attempt to be objective in the evaluation of 
readiness for promotion, the .judgment is inevitably somewhat subjective, so 
that fluctuation of standards might unwittingly be introduced. 

Such issues cannot be definitely resolved at this time. The basic question 
to which the study was addressed has been answered. There is no significantly 
greater increase in promotion rates in target schools than in control schools. 



Jacobs, Janes IJ. , ”A Critical Evaluation and Study of Nonpromotion in the 
Cincinnati Public Elementary Schools." Jo^nal of Instructional Research 
and Program Development, Volume 2, May, 1967> PP* 113-133 • 
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The total implications of this fact must be derived from the broad overview 
of all the findings of program and project evaluation. It is entirely 
possible that several years of continuous assessment will be needed to measure 
the effect of concentrated services on the deprived youngsters in target schools. 
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CHAPT_^ 9 
DROP-OUTS 

Description 

Definitions of the term drop-out are varied, but perhaps the most typical 
includes any pupil who leaves school before graduation or completion of a 
program of studies without transferring to another full-time school program. 
Although this definition is typical, it is not universally accepted. Some 
would argue that this concept of the term drop-o ut includes many pupils who 
eventually attain their educational goal. They may do this through a less 
structured program than that of the regular da>y school, or they may leave 
school with the idea of terminating education but return later to finish. 

Despite this disagreement, the abo\^ definition has been adopted for 
the report. Data on the number of pupils withdrawn from the Cincinnati Public 
Schools and the reason for their withdrawal are available from reports of 
census changes. Reasons for withdrawal that seem to warrant classifying a 
pupil as a drop-out under the above definition include the following: 
government services, pregnancy, illness, work permits, home permits, psycho- 
logical exclusion, superintendent’s expulsion, and age beyond compulsory 
attendance. Also included is an ambiguous miscellaneous category, most 
often the disposition of these cases was pending at the time of withdrawal. 

At the secondary level, however, it is likely that the majority of them 
discontinued their education. 

It should be noted that the drop-out statistics in this report should not 
be compared with those of other school systems without a careful examination 
of the basis for classification. A considerable amount of ambiguity remains. 
Standardizing the method of data reporting does not prevent differences in 
individual judgments in the classification of cases and other related issues. 

The thoroughness with which pupils are followed after leaving school is 
another issue that suggests extreme caution in comparing drop-out rates. The 
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period from June to September has been excluded completely from this report 
because of the impossibility of obtaining accurate information for this period. 
Students expected at a given school who do not appear "when school opens often 
continue full-time education elsewhere. Although an effort is made to trace 
each of these pupils who is of compulsory school age, there are no collected 
data reflecting how many are drop-outs. 

The term drop-out rate refers to the ratio of the number of drop-outs from 
the period of September to June to the total number of pupils for whom the school 
is accountable (drop-outs plus end-of-year membership). This total accounta- 
bility figure includes all pupils enrolled in a school in a given year except 
those who have been withdrawn as deceased, or for whom it is reasonable to assume 
that full-time education was continued. Graduating seniors are counted in the 
twelfth grade end-of-year membership. 

The rationale fcr using drop-out rates to assess the effectiveness of the 
Education Act program is based on the fact that an important goal of the Title 
I effort is to make the learning experience more meaningful in the life pattern 
of the pupil. Unless this effort has been successful enough to motivate the 
pupil to stay in school, he can hardly be said to gain appreciably from the 
services offered. 

Method of Analysis 

Because the greatest effort under Title I has been expended in primary 
target schools the first signs of improvement of the drop-out situation would 
be expected here. Although fewer funds have been used locally at the secondary 
level than at the elementary, there is some possibility that a year and four 
months of intensified effort might have led to a noticeable decrease in the 
drop-out rate. 

This report continues the analysis of drop-out rates in the report of last 
year. Changes in the percentages of drop-outs that have taken place in I965-66 
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and 1966-67 are compared among the primary target, secondary target, and 
control schools. The basis for determining these changes is the baseline 
established in last year's report for the years 1963-64 and 1964-65, repre- 
senting the period prior to the advent of the Education Act, 

For each of the three time periods, drop-out ratios at the secondary 
level were computed for each grade. Because the percentages of pupils 
leaving school at the elementary level is too small to be meaningful, these 
data were not compiled for this year’s report. 

A second comparison is made of the drop-out percentages of grades 7 
through 12 in the target schools with those in the non-target schools through- 
out the Cincinnati school district. The comparison is parti cularlj'- critical 
for grades 10 throu^ 12 since the secondary target and control school groupings 
contain no senior high school to compare with the one in the primary target 
group. Drop-out rates are typically highest in grades 3.0 and 11 . 

Results 

To permit comparison of a change in drop-out rates in target and control 
schools, table I5 shows the percentages by grade and type of school for each 
of the last four years. Each j'-ear is recorded separately because of the 
diversity in the two years that may be considered the baseline period (1963-64 
and 1964-65). Tlie 1965-66 school year represents a partial period of Tit 3 .e I 
services and I966-67, the first full year of services. Each of the junior 
and senior high school grades is included, although the rates at grade seven 
are too small to have much meaning. 

Examination of table I5 indicates that drop-out rates in the primary 
target schools have generally increased within the past school year. This is 
true in comparison both to the baseline period and to I965-66. Increases 
occurred at all grade levels except seventh, but were greatest in grades ten 



and eleven. 





Table 15 . Percents of Pupils Cropping Out of Primary Target, Secondary Target, and Control Schools (September- 
June) by Grade and Year. 
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By comparison, the primary target rates in grades 7-9 increased less from 
1965-66 to 1966-67 than either the secondary target or control percentages. 

Viewed in relation to the two-year baseline period, though, the primary and 
secondary target rates show about equal increases while the control rates 
have decreased. 

It is in grades ten and eleven, however, that the highest drop-out rates 
regularly occur. Unfortunately, the control school grouping includes no senior 
high school. For this reason, table I6 allows a comparison of the target school 
drop-out rates viewed collectively with those of all non-target, secondary level 
public schools in Cincinnati. Table I6 indicates that the target school drop-out 
rates are hi^er at every grade level than those of non- target schools. This 
difference averages 3.5 per cent per grade in I966-67. Interestingly, the 
highest drop-out percentage in the primary target school has been at the 
eleventh grade level for the past two years. In non- target schools, on the 
other hand, grade ten has regularly shown the highest rate. 

As noted earlier, the drop-out rates for target schools were higher in 
1966-67 than in either the baseline years or in I965-66. A look at table I6 
shows that this is also generally true of the non-target school rates. A 
comparison of the increases that have occurred over the average of the two 
baseline years shows a mean increase of 1.1 per cent for target schools and 
of 1.2 per cent for non-target. Thus, it appears that per cent of increase 
in target and non-target schools over the baseline years is about the seme. 

An inspection of the stated reasons for withdrawal gives an indication 
of why this is so. Of the nine reasons for withdrawal that are considered 
drop-out categories, four were found to include 86.3 per cent of the total 
numer of drop-outs in grades 7 through 12, over the four years covered by 
this report. The categories Work Certificate and Miscellaneous contain rather 



large numbers at both the junior and senior hi^ school level, while Over-Age 
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and Pregnancy include a substantial number at thr senior high school level but 
few in grades 7 through 9. Table 17 shows the average number of pupils with- 
drawn from grades 7 through 12 for the two baseline years and the per cent of 
increase in each of the two succeeding years by reason and type of school. 
Percentages have not been figured for cells that do not exceed 10 cases in at 

least one of the four years. 

Table 17 . Mean Number of Pupils Withdrawn from Grades 7 through 12 in IVo 
Baseline Years and Per Cent of Increase in I965-66 and 1966-67j 
by Reason and Type of School. 





Work 

Certificate 


Over-Age 


Pregnancy 


Miscellaneous 


Primary Target 


Baseline Average N 


84 


38.5 


56.5 


69.5 


^ Increase 65-66 


-1.2^ 


-9.H 


-Z.Tf, 


13*7% 


io Increase 66-67 


21.4 


35.1 


16.8 


15.1 


Secondary Target 


Baseline Average N 


59.5 


2 


34.5 


59 


^ Increase 65-66 


k.2i 


— 


-iM 


6.8% 


^ Increase 66-67 


14.3 


M mm ^ 


-21.7 


49.2 


Control 


Baseline Average N 


17 


0 


2 


19 


^ Increase 65-66 


hl,l1o 




WWW 


-15.8% 


^ Increase 66-67 


135.3 


“ 


w ^ w 


21. 1 


Other 


Baseline Average N 


249 


141.5 


67.5 


366 


^ Increase 65-66 




52.7?i 


-ll.lfo 


V-3$ 


j} Increase 66-67 


63.8 


37.1 


25.9 


48.9 



In interpreting this table, several facts must be kept in mind. First, the 
high school grades, where most drop-outs occur, are represented only in 



the primary target and other groupings. There is one primary target senior high 
school and seven in the other grouping. Secondly, the two years in the baseline 
period have been taken together, although the pattern has typically been a steady 
increase from 1963-64 on. 
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The categories Work Certificate and Miscellaneous tend both to include 
the largest number of students and to show the greatest increases. In primary 
target schools, however, it is the Over -Age category that has increased most 
over the baseline. The increases for schools in the other grouping are greater 
on a percentage basis for each of these fovoc critical categories of reasons for 
withdi;awal. 

Discussion 

From the results reported in the preceding section, two primary facts are 
obvious ; 

1 . There has been a general increase in the number of drop-outs in 
the Cincinnati schools over the past four years. This increase 
has continued in the I966-67 school year even in the target 
schools, which have received ESEA services. 

2 . The increase in drop-out rate in the target schools has been 
slightly less, possibly as a result of Title I services, than 
that in non-target schools. 

Some may be distressed by the fact that target school drop-out rates have 
continued to increase, thus remaining somewhat larger than those of other 
schools. Exploration of the reasons behind pupils leaving school seems to 
be very important in this regard. It is recognized that the stated reason 
for withdrawal seldom tells the whole story. Behind each pupil who leaves 
school under the heading Work Certificate or Over-Age or even with work 
certificate pending, to be classified as a M iscellaneous drop-out, there 
is generally a history of extended personal frustration. Sometimes this 
is a perennial inability to succeed in school or a lack of interest in the 
program offered by the regular day school. Sometimes it is a history «-f 
continuing economic indigence, perhaps including parental pressure to find 
a means of self-support. In any case, the problems that accompany cultural 
deprivation are too numerous and complex in their causation to be remedied 



in the course of a year or two. 
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Of some hope is the large mimber of youths of school age and just beyond 
who are currently engaged in continuing education programs and other areas of 
skill training and self improvement. In many cases these young people have 
found a means of self support while they are continuing their education on a 

_«4« 4rwo Voo*? O 

Of considerable interest in this regard is the effect of counselors who 
have been assigned under Title I to three high schools in Cincinnati as job 
coordinators. The role of these professionals will be discussed in more 
detail in the evaluation report of the Secondary Remediation and Enrichment 
project. It seems appropriate to note here 5 however, that these personnel 
have been assigned not only to the one primary target senior high school but 
also to two other high schools that qualify as secondary target ischools but 
have not been included in this program evaluation report because iGhey receive 
no other Title I services. The duties of these counselors consist of working 
with pupils that have been identified as potential drop-outs, encouraging them 
to remain in school, or helping them to make other appropriate plans for con- 
tinuing their education or training and becoming gainfully employed. 

The secondary project report will provide evidence of the effect that 
these counselors have had as far as ^^op-out rates are concernedo It may be 
noted briefly, though, that in schools with a job coordinator, the number of 
pupils withdrawn with work certificates has increased dramatically over the 
baseline period, while in the other five senior hi^ schools this number has 
remained relatively stable. At the same time, those pupils for whom the 
category heading Over-Ag e and Miscellaneous suggest withdrawal without an 
immediate means of self-support, the increases in schools with and without 
job placement coordinators have been similar. This information provides 
considerable hope that the larger number of pupils \/ho are withdrawing, 
especially from schools served under Title I, are withdrawing with purpose. 



I 



They are moving toward a goal rather than merely fleeing from an undesirable 
situation. Coupled with the evidence that target school drop-out rates are 
increasing more slowly than those in other schools, the fact yields a rather 
hopeful composite picture of the effects of ESM services in this area. 
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CHAPTER 10 

PSYCHOLOGICAL REFERRAIS 

Description 

Each year, several thousand pupils are referred by classroom teachers and 
others to receive service from the Division of Psychological Services. Most 
referrals originate from the child’s teacher since she is likely to be the first 
to recognize child needs. Each referral contains a variety of information about 
the child which not only provides background information to the school psycholo- 
gist but also determines the priority of service. No restriction has ever been 
placed on the number of referrals that may be made by a school. Of all referrals 
made in the course of a year, about seven out of ten are actually seen by a 
school psychologist— this being a function of the limited staff available to 
give service. 

During the past year, records have been kept not only on nun\bers of referrals 
made by school but also upon the type of referrals made. It is hypothesized that 
the number and type of referrals characteristic of PT and ST schools over a 
period of time may reflect the extent of school related and other problems of 
pupils. Further, it is hypothesized that the ESEA program, with its many 
services designed to prevent such problems, will lead to a reduction of referrals. 

Methods of Analysis 

The data currently available do permit comparison of total referrals made 
by PT and ST schools for I965-66 and I966-67. These data were expressed as 
percents of referrals made in all Cincinnati Public Schools. These proportions 
for the two years were tested for significance of difference using the chi 
square statistic. 

The type of referra].s made by PT and ST schools for I966-67 only was 
reflected by percents in each category. Control schools are not included in 
the analysis because they are few and likely to reflect unreliable statistics, 

u 
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Results 

A summary of psychological referrals is shown below. 



Table 18 . Numbers and Percents of Psychological Referrals Made by Grade 
Level, Year, and School Group. 



Level 

School Group 


1965-66 

IkT 

n 

i^L 


1966-67 

IM 




Per Cent 
Lifferenee 

’67 - ‘66 


Elementary Schools 


PT (12 schools) 


1057 


1016 






{19.28%) 


(16.81^) 


- 2 . 47 ^* 


ST (17 schools) 


1316 


1420 




Secondary Schools 


( 24 . 01 ?J) 


(23. 50 ^) 


- .51 


PT (4 schools) 


124 


182 






(2.26%) 


( 3 . 01 ^) 


+ .75 


ST (4 schools) 


105 


131 






{i-sH) 


(2.16<^) 


+ .25 


Total Referrals Made; 


Target Schools 


2602 


2749 




(47. 46^) 


(45. 48 ^) 


-1.98* 


Non-Target Schools 


2879 


3292 






(52. 5 w 


(54. 52 ^) 


+1.98* 


City-Wide 


51*81 


6o4l 





*Statistically significant at 5 % level. 



The results show that of the 5^81 referrals made city-wide in I965-66, 
47 . 46 ^ originated in target (PT and ST) schools; the remaining coming from 
non-target schools. In 1966-67? 45.48^ (of 6o4l) came from target schools — 
a decline of 1.98^. The two way contingency table formed by year (66 vs. 67) 
and school group (target vs. non-target) produced a significant chi square 
value of 4.52. Thus, the decline of 1.98^ in target schools is not likely 
to be a matter of chance. 

Inspection of the upper portion of table I8 shows that the decline in 
target schools occurred in elementary PT and ST schools but to the greatest 
and most significant extent in the PT elementary schools. 
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Table I9 breaks down the total number of referrals made in I967 "by type. 

It is noted that the majority of referrals were classified as ’’advice on 

educational plans." The least number of referrals was made on "family and 

community- problems . " In succeeding years , the types of referral categories 

■^/xll be analyzed in a manner similar to that showii in table 19. It is hoped 

that the Education Act program in the future will reduce the number of 

behavior problems shown in referral types two and three in table 19. 

Table I9. Percents of Types of Psychological Referrals Made in 1986-67 by 
Level and School Group. 




I 




Type of 
Referral 


Elementary Schools 
PT ST 


Secondary Schools 
PT ST 


1. 


Advice on Educational Plans 


43.3fo 


37. 


19. 2^ 


33. 


2. 


Personality- Behavior Problems 


13.8 


12.2 


28.0 


33.6 


3. 


Academic and Behavior Problem 


20.4 


22.4 


- 20.9 


16.8 


4. 


Family and Community Problem 


.2 


.1 


mm 


- 


5. 


Other 


22.3 


27.4 


31.9 


16.1 


Total Number of Referrals 


1016 


1420 


182 


131 








Discussion 

The use of psychological referrals as a criterion of the educational 
and mental health of the target area pupils has some validity yet has two 
serious limitations. First, both the number and types of referrals made 
depend largely on the school staff. It was for this reason that control 
schools were not included in the summaries because there were so few of 
them that the results would be too unreliable. With the larger number of 
schools in the PT and ST areas, the reliability should be fairly high from 
one year to the next. Second, making referrals may be a relative matter. 
Problems of children may be reduced in seriousness yet the number of 
referrals may remain the same simply because the service is available. 
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The Education Act^may serve to identify problems which heretofore had been 
unseen thus actually causing an increase rather than decrease in referrals. 

In the comparison of number of referrals made from 1966 to 1967 > there 
was a significant decrease in target schools which occurred mainly in PT 
elementary schools. Whether or not this decrease can be attributed to the 
Education Act is a moot question but taken along with other information, it 
may reflect Education Act impact. 




CHAPTER 11 
COST OF VAUDALISM 



Description 

"'he cost of vandalism in primary and secondary target schools was investi- 
gated to determine if a noticeable difference among schools exists and to provide 
baseline data for future study. 

It is reasoned that the ESEA program will result in better attitudes toward 
school, and that less destruction of property at the schools receiving the most 
services will be noticed. It is recognized that vandalism costs of a school are 
not necessarily perpetrated by pupils attending the school. In elementary schools 
particularly, acts of vandalism may or may not be executed by children attending 
the school. Freq.uently, older children are responsible. Thus, the costs due to 
vandalism may reflect the behavior of persons in the whole area rather than simply 
pupils attending the school. It should be realized that many schools in the target 
area provide the only playground space available to children living in that area. 
Use of the school playground before and after school hours and on weekends is 
commonplace. Such conditions make it difficult to distinguish damage due to normal 
use from malicious destruction. 

Methods of Analysis 

Annual vandalism costs for all PT and ST schools were secured from the 
Department of Business Administration of the Cincinnati Public Schools. Glass 
breakage figures also were obtained. These figures were indicated on a monthly 
basis, so the statistics for the ten month school year (September- June) were used. 
According to cost statistics, the glass unit cost in I966 was $ 5 • 89 * The total 
units per ten month period per school were multiplied by $5*89 "fco obtain a total 
glass breakage cost per PT and ST school. This cost was combined with the cost 
of vandalism to obtain the total cost for the I965-66 school year. The small 
number of control schools prohibited analysis because the reliability of cost 
indices would be too low. 



As the glass breakage figures for 1966-6? were only available through December 
at the time of this writing, these figures vrere averaged, projected over ten months, 
and combined with the vandalism costs to obtain the total cost for the 1966-67 school 
year. We have chosen to estimate costs for the school year, rather than a calendar 
year (vandalism is higher in summer months than school months) because the school 
year costs are more likely to be the result of persons living in that school’s 
district. Further, better records can be kept during the school year. Cost records 
are only as valid as the reports submitted by principals. All acts of vandalism 
are not reported by the principal — such costs being borne from school funds. The 
average cost for I965-66 and 1966-67 for primary and secondary target schools 
(elementary and secondary level schools were grouped together in each case) was 
obtained by dividing the total cost by the number of schools in the category. The 
t ratio was computed by finding average costs for each PT school for the two year 
period, and averaging costs for each ST school for the two year period, and com- 
paring the difference between the means for these two groups with the standard 

r 

error of a difference between the means. 

Results 

Summary of costs due to vandalism are shown in table 20, Inspection of table 
20 shows wide variation in vandalism costs from school to school. The average 
cost per primary target school from 1966 to I967 is, however, very similar; $600 
and $587 for 1966 and 1967? respectively. This difference is not significant. 
Similarly, average costs in ST schools are about the same; $710 and $?40 for 
1966 and 1967, respectiveily. Comparison of average costs between PT and ST schools 
shows them to be higher in ST schools. The differences, however, are not statisti- 
cally different, this being a function of the wide variation within sets of schools. 

As a matter of interest and control, figure 2 shows the number of lites (glass 
panes) broken in PT, ST, and all Cincinnati schools by month for the year I965-66. 
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Table 20. Cost of Vandalism and Glass Breakage in Primary and Secondary Target 
Schools from September through June of I965-66 and 1966-6?* 



School 


Primary Target 
Cost 

'66- '67 


Cost 

’66- ’67 


School 


Secondary Target 
Cost 

’66- ’67 


Cost 

■66- '67 


1.* 


$ 376 


$ 883 


1.* 


$ 390 


$ 664 


r\ y. 

C. 




294 


2. 


304 


)i6« 


3. 


638 


780 


3. 


182 


1084 


k. 


784 


309 


4. 


753 


1428 


5. 


618 


585 


5. 


709 


744 


6.* 


556 


816 


6. 


1737 


767 


7. 


715 


833 


7. 


667 


492 


8. 


88 


221 


8. 


507 


1119 


9. 


649 


635 


9.* 


928 


1245 


10.* 


247 


611 


10. 


1575 


1796 


11. 


1358 


1113 


11.* 


l401 


870 


12. 


253 


133 


12. 


171 


0 


13. 


153 


536 


13. 


218 


473 


14. 


283 


401 


14. 


1291 


66:; 


15. 


860 


660 


15. 


1475 


1114 








16.* 


464 


550 








17. 


292 


422 








18. 


586 


477 








19. 


398 


276 








20 c 


212 


293 








21. 


656 


613 


Average Cost $ 6OO 


$ 587 




$ 710 


' $ 7k) 


Difference 












•67- ’66 


$-13 




$+30 



•J^secondary scnoois. 



The facts shown in figure 2 and their implications are well known by the 
Business Department. Glass breakage appears cyclical and highly consistent 
among PT, ST, and all Cincinnati schools. 

Discussion 



While no significant difference was noted in costs of vandalism and glass 
breakage from I966 to I967 in either PT or ST schools, these data do represent 
a good benchmark for future comparison. 

Generally, it appears that schools in both PT and ST categories which have 
grounds near or adjacent to housing have less glass breakage and vandalism. It 
is reasoned that malicious damage is less likely in these areas without being 
detected. During the recent civil disturbances in the city the most destruction 
of property (public and private) occurred in the area? of the secondary target 
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schools. In these areas in the city there is a great mobile population and 
perhaps more general dissatisfaction. Thus, the findings relative to average 
cost of vandalism and glass breakage per PT and ST school does correlate with 
the observed conditions in the city. 



CHAPTER 12 

SUMMARY AND GENERAL FINDINGS OF PART I 

Siimmary 

Part I has attempted to assess the impact of the Education Act program 
in target schools on a gross basis. The interest and analysis has been on 
change and status in target schools. The general hypothesis tested was 
PT>ST>C which reflects the order of ESEA program service intensity. It 
was recognized that school-wide change due to ESEA. was not likely to occur 
because potency and extent of treatments per pupil, or per teacher are very 
low for the school as a whole. In spite of this, the strategy was applied if 
for no other reason than to verify baseline data. 

Several criterion measures were applied to test the general hypothesis. 
Analysis was made of each measure both in terms of change from I966 to 1967 
and status in 19 ^ 7 . "While the reliability and validity of some of the criteria 
are not established, it is the general picture which is most important. 

General Findings 

1 . Teacher Survey o In general, teacher survey results did not confirm 
the general hypothesis but there are some important exceptions. Over- 
all changes in primary target school teacher evaluations were either 
equal to or less than ST or C while 1967 ratings generally favored 

PT over ST. Typically, teacher survey factors which measure concrete, 
visible objects or services were rated higher by PT teachers than ST 
or C. This pattern is consistent with what was actually done in PT 
schools; e.g., the presence of remedial and resource teachers, special 
education classes, resource centers, after-school clubs and enrichment 
activities, Saturday morning classes. Evaluative ratings of pupil and 
parent characteristics did not change and remained low in target schools. 

2 . Administrator Survey . The general finding was confirmation of the 
general hypothesis; PT> 3 T, both in terms of change and status. There 
is a tendency for administrators to evaluate survey items higher than 
teachers although there is high correlation. Evaluative ratings of 
pupil-parent characteristics, while higher than in 19^6, are a full 
unit under those given by other administrators in non- target schools. 

3. Student Survey . Practically no difference was noted in student 
response to the survey from 1966 to I967 in PT, ST, or C. The 
1967 responses, however, continue to confirm the general hypothesis 
especially for elementary pupils. 
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In comparison to suburban pupils, target school pupils tend 
to like school more. Suburban pupils, however, read more, and 
have higher aspiration than target pupils. They also worry more 
about school work and have higher parent interest than target 
children. Self-image and ego strength appear about the same 
between target and suburban children. 

Girls seem better adjusted to school than boys and generally 
seem to value education more than boys. As pupils progress in 
school, they become increasingly disenchanted through the junior 
high grades with a striking change in the shift from elementary 
to secondary school. 

4. Parent Survey. A general decline in affirmative response was 
noted for PT, ST, and C. PT decline, however, was larger than 
either ST or C. In terms of 1967 response only, PT, ST, and C 
responses were similar. The larger decline among PT parents 
probably is a function of the relatively high percent of 
affirmative responses made in I966. 

Target and suburban parent response differences generally 
confirmed those factors thought of as distinguishing these two 
groups. Thus, suburban parents have higher aspiration levels 
for their children, are more active in school, eind are optimistic 
of their children’s school work. Target parents want to know 
more about the school but apparently do not involve themselves. 

5- Academic Achievement . Based on an abbreviated testing 

program in 1967 conducted in grades 2, 4, 5? 7> ^d 10, the 

general finding was C>6T>PT, which is no different from last 
year’s results. 

Valid comparisons between 1966 and I967 achievement could 
only be made in grades 4, 6, and 7- Of the 102 comparisons made 
at three quartile points for the three grades and all subtests 
in PT and ST, 29 showed positive change, 37 negative change, and 
36 no change. Positive and negative change was about even in 
PT and ST schools. Control schools, however, showed more 
positive change in the fourth grade, equal gains or losses in 
the sixth grade, and more losses than gains in the seventh 
grade. The picture with respect to target school increase 
over 1966 in comparison to control is inconsistent. There is 
a tendency toward slight decrease in pupil achievement in the 
target schools. 

6. Pupil At tendan ce . Average daily absence in primary target schools 
has in^eased from base years to 1965-66 and 1966-67. In secon- 
dary grades, the absence pattern is PT>STX! — this being true in 
1966 as well as 1967* In the elementary grades absence is not 
only greater but also increasing faster in PT compared to ST or 

C. 

7. Promotion Rates . There was a trend for promotion rates to increase 
in all grades and about the same in PT (l.2^), ST (l.4%), and C 
(1.7^) in comparison to baseline data. With respect to I967 promotion 
rate, the general picture was C>ST>PT, 
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Drop-outs . Rate of drop-out has increased in target and non-target 
secondary schools in Cincinnati. Drop-out rates remain hi^er in 
target than in non-target schools. Comparing drop-out rates from 
1966 to 1967 shows generally PT ST C. 



Psychological Referrals . The number of psychological referrals 
in PT and ST schools for I965-66 and I966-67 was compared with 



those from non-target schools. A significant decrease in referrals 
from target schools was noted; this occurring mainly in PT elemen- 
tary schools. 



Cost of Vandalism . These costs were determined for the school years 
1965-^ and 19^6-67 for PT and ST schools. Both PT and ST showed 
similar average costs for the two years. ST school costs due to 
vandalism were higher than PT but not significantly so. 





PART II 



ANALYSIS OF PUPIL SAMPLE 
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General Description 

The reader is referred to the introductory chapter to understand the 
definition of the sample and how it was selected. Suffice it to say here, 
the sample consists of some pupils who have received more intensive ESEA 
services and who, therefore, stand the test chance of showing improvement 
as compared to various other comparison groups. We define five groups 
comprising the sample: 

HSPT - high service pupils in £rimary target schools 
ISPT - low service pupils in primary Jbarget schools 
HSST - high~£ervice pupils in secondary target schools 
ISST - 3 -ow service pupils in secondary target schools 
NSC - no £ervice £ontrols 

The general hypothesis is; HSPT>HSST>ISPT>ISST>NSC either with respect 
to change or status. The hypotiiesized order corresponds, we believe, with 
ESEA. treatment intensity. 

While pupils in the five sample groups were matched with respect to 
grade and sex, it is obvious that there are no real counterparts to the 
KSPT groupo By definition, these pupils are in greatest need of further 
help, thus they form an ’’unmatchable** group. The remaining four groups 
are simply the closest matches with HSPT there were possible. This fact 
mitigates against unbiased comparisons and is the most serious deterrent 
to valid generalizations of the effects of ESEA. The sample was drawn 
from grades 2, 4 , 6, 7> and 10. 

Several criterion measurements were made of the five groups consti- 
tuting the sample. Some of these measures are the same as those reported 
in Part I. Ir^ most cases, measures are available for sample groups both 
for 1966 and I967 thus permitting comparisons of both status and change. 



mKRmmtBm 



\ 







92 



CHAPTER 13 

PUPIL ACADEMIC ACHIEVEMENT 



Description 

Pupil academic achievement has been gauged by standardized achievement 
tests and by end of year marks given in the basic academic subjects. Descrip- 
tion of the achievement tests was given in chapter 6 and will not be repeated 
here. End of year marks in Cincinnati Public Schools consist of the letter 
grades A, B, C, D, F. In spite of the fact that teacher marks are known to 
have limited reliability and validity they are, nevertheless, the major index 
upon which promotion is based and represent a teacher's judgment of pupil 
achievement. Marks were obtained directly from school records at the end of 
the year and were converted to numerical ratings where four points were 
equivalent to an A, three points to B, two points to C, one point to D, and 
zero points for F. 

Methods of Analysis 

Standardized achievement test grade scores and marks in the basic academic 
subjects were obtained for both 1966 and 1967 for all five groups in the sample 
and for the five grade levels studied; i.e., grades 2, 4 , 6, 7 ? ^^nd 10. 0 bvious 3 .y, 
test data and marks for 1966 were obtained from the previous year’s grade level. 

Achievement Tests . It was pointed out that the HSPT groups at each grade 
level were \inmatchable especially in terms of achievement. Any method of 
analysis which did not account for lower initial achievement would be unacceptable 
since it would bias the comparison in favor of the initially higher group. The 
objective, of course, is to measure achievement from I966 to ..V and not before 
1966 which is pre-ESEA. We settled on a co-variance type rf analysis which 
corrected 1967 criterion data on the basis of its correlation with the s^e 
measiire in I966. 

The basic problem in analysis was to compare the adjusted I967 achievement 
test data among HSPT, ISPT, HSST, IBST, or NSC per grade and per criterion 
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measure--of which there were 28 test measures. All comparisons did not involve 
all five sample groups. An elaborate multiple co-variance analysis of criterion 
data was programmed on computer by Dr. Richard Johnson who served as statistical 
consultant to the Division of Program Development. Detailed description of the 
program analysis will not be made here* except to point up some of the important 
outputs. Five co- variables were identified — the "pretest” measure and four 
variables identifying sample group membership. For each variable, means and 
standard deviations are produced as well as zero order correlations of the 
co-variables with the criterion variable. The regression coefficients and 
standard errors are also computed for each co-variable as well as the multiple 
correlation with the criterion. Finally, t values are computed between each 
co-variable and ISPT, the latter being an arbitrarily selected reference point. 
Thus, for example, the adjusted criterion means for HSPT vs. ISPT are tested 
for significance by the t statistic as well as other groups; e.g., HSST vs. 

ISPT and ISST vs. ISPT. 

The strategy was to use the above program on those variables which, upon 
inspection of means, seemed to hold the most prcmiise of significant difference. 
If significance of difference was not observed, the remaining variables would 
not be analyzed. 

Pupil Marks . Pupil end of 3 'ear marks were averaged for each grade and 
subject resulting in grade point averages (GPA). A computer program was 
written which generated means, N's and the standard error of means for each 
subject, grade level, and group. Inspection of the I966 and 1967 GPA’s 
indicated that elaborate analysis was not warranted. Differences were tested 
for significance through the t statistic. 



*Persons interested in the mathematical details or the computer program itself 
may obtain further information by siting the Division of Program Development, 
Cincinnati Public Schools. 



standardized Test Achievement . Table 21 summarizes the average grade 
scores by sample group, grade, and subTicst. All means, pretest (1966) and 
post-test (1967) are based only on those pupils for whom both scores were 
available. Thus, we are assured that the same pupils are represented in 
pre- and post-test. Comparisons involving less than twenty pupils are not 
reported because of their unreliability. 

It is noted that in grades 4 and 6, comparative achievement could be 
analyzed across all five sample groups while in grades 2 and 7 only three 
groups (HSPT, ISPT, and NSC) could be compared. Only HSPT and ISPT could 
be compared in grade 10 . Missing groups are explained by the fact that such 
groups were non-existent as defined. 

Before results of analysis are reported, several observations based on 
table 21 should be made as follows : 

1. HSPT pretest grade scores are consistently lower than those of 
the remaining four groups. This fact attests to the selective 
nature of the groups obtaining intensive ESEA services. The 
achievement of sample pupils, particularly HSPT, is below that 
of the average of the schools they attend (see table IC). 

2 . All but a few differences reported reflect a significant gain 
in achievement from I966 to I967. Word study skills in grade 
2 and arithmetic application in grade 6 for HSPT are examples 
of the exceptions showing no significant gain. 

3. The subtest which best ’identifies” the HSPT group is language. 
Language pretest means for HSPT are lower in relation to other 
groups as compared to other subtests. HSPT pupils were selected 
much on the basis of poor language development. 

4 . The pattern of subtest means parallels that found for the schools 
as a whole. Thus, spelling and arithmetic computation generally 
are relatively higher than other subtests while language scores 
are usually lowest. 

5. Gains made by HSPT are generally lower than those made by LSPT. 
Similarly, gains made by HSST are generally lower than LSST. 

Gains made by nSC seem to be randomly higher, equal to, or lower 
than the other four sample means. 

The results of the regression analysis described briefly earlier supported 
what one might infer from inspection of the means and gains in table 21 . After 
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Tible 21. Average Stanford Achievement Pretest and Post-test Grade Scores and Dlfferei.ces from I966 to 1G67 for the PITPIL SAMPIB by Grade. Subtaat. 

end Sample Group. ’ 



Oracle 

Test 

Date Administered 
Subtest 


H 


s 


P 


T 


L 


S 


p 


T 


H 


S 


s 


T 


N 


Pre 


Post 


Gain 


N 


Pre 




Gain 


N 


Pre 


Post 


Gain 


GRADE 2 
























Stanfoid Primary I 


























Pretest: Oct* *66 


























Post- teat: l^y *6? 


























Word Meaning 


qB 


1.33 


1.8,9 


.56 


86 


1.38 


2.07 


.69 










Paragraph Meaning 


97 


1.45 


1.89 


.44 


86 


1.56 


2. OF 












Spelling 


49 


1.25 


2.10 


.85 


50 


1.34 


2.19 












Word .Gtudy Skilla 


23 


1.47 


1.50 


.03 


20 


1.43 


1.20 


-.?3 










language 


97 


1.43 


1.91 


.48 


8.9 


1.52 


2.11 


.59 










Arith, Computation 


96 


1.43 


1.93 


.50 


91 


1.59 


2.13 


. s4 










OHADB 4 


























Stanford Intermediate 


I 
























Pretest: May *66 


























Post-test: May *67 


























Word Meaning 


63 


2.55 


3. IP 


.57 


56 


2.61 


3-34 


.73 


63 


2. 71 


3-31 


.60 


Parap,r*^ph Meaning 


65 


2.26 


2.85 


.50 


•'7 


2.49 


3.01 


.52 


63 


2.45 


3.14 


.60 


Arith. Computation 


64 


2.86 


3.53 


.67 


55 


2.92 


3.6.8 


.76 


65 


2.80 


3.34 


.45 


Arith. Concepts 


65 


2.49 


3.24 


.75 


5'-. 


2.69 


3-45 


.76 


64 


2.44 


3.04 


.60 


GRADE 6 


























Stanford Intermediate 


II 
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appropriate adjustiaent of post-test means in relation to pretest means, the 
general finding was no significant difference among groups. This generaliza- 
tion is based on separate analyses of spelling, pai*agraph meaning, and arith- 
metic computation in all grades represented. Further analyses did not seem 

1 rnir>v»Qn'l* c 1 nr>o v»oma n n i nrr rrPinc V)nr •; QT\r>oa v» 



different from those analyzed. In spite of the lack of significance of 
difference among the five sample groups, one cannot overlook the trend, small 
as it might be, for LSPT>HSPT. This is reflected in the fact that of the 27 
comparisons of gains (all subtests and grades), I 9 were in favor of ISPT, and 
only 7 favored HSPT; one being equal. All post-test means of LSPT, except 2, 
were higher than HSPT. Much the same situation exists in comparing HSST and 
LSST. Of the 11 comparisons of gains, LSST made higher gains in 8 while HSST 
was higher in two and one showed equal gain. 

Of interest is the fact that most pretest-post-test correlations were in 
.5 to .6 range while the regression of post-test on pretest was usually in .6 
to .7 range. The latter observation verifies previous investigation showing 
that target pupils typically achieve the equivalent of 6 to 7 months of growth 
per 10 month school year. 

End of Year Marks . Table 22 summarizes the average end of year marks 
given to the sample groups in the basic subjects. Average marks given to 
these groups at all grade levels generally are in the 1.00 to 2.00 range 
indicating a preponderance of D's or below average academic performance. As 
with achievement test results, the previous year’s performance of HSPT is 
generally lower than the LSPT and that of HSST is generally lower than ISST. 

There are 46 differences reported in grade point averages in table 22. 

Of the 46, 28 show decrease from I 966 to 1967 * In contrast to test achieve- 
ment reported as grade equivalents where growth is expected, marks do not 
reflect growth from year to year, per se. Thus, we may ask which and how 



Table 22. Average End of Year Marks in 1966 and 1967 ancj Differences for the PUPIL SAMPLE by Grade, Subject, and Sample Group. 
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many of the 46 differences actually represent significant increase or decrease. 
Based on the standard error of the mean statistic, it was found that 10 of the 
46 differences were significant; 8 of which were decreases and 2 of which were 
increases. One of two increases was in HSPT grade 1 . English, while the other 
was in NSC grade 6, Language Arts. 

In spite of the general lack of significant difference in marks from one 
year to the next there is a tendency for HSPT differences to show relatively 
higher gain than ISPT. Of the 13 difference comparisons, HSPT>IBPT, relatively 
speaking, in 11. In contrast, ISPT>HSPT, in 10 of the I3 comparisons of I967 
means. Thus, ISPT show higher achievement in 1967 while HSPT generally show 
more gain . 

Discussion 

The data presented in this chapter show no evidence that pupil academic 
achievement has "been increased significantly as a result of ESEA services. The 
standardized achievement tests reveal a slight trend favoring the non-ESEA groups 
while teacher marks show a slight trend favoring the high service ESEA groups. 

The general picture, however, is no significant difference. 




o 
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CHAPTER 14 

PUPIL ATTITUDES AND SELF-IMAGE 

Description 

This chapter continues comparison of the five sample groups. Four 
instruments were used to measure pupil attitudes and self-image: Student 

Survey; What I Am Like* Attitudes Toward Self and School; and the House-Tree- 

Person Test. 

Although these instruments may he viewed as having construct or theoretical 

yaixdity, none has established predictive validity. As hi^ly experimental 

measuring devices, they should not be considered generally reliable for individual 

pupil diagnosis. Rather, the purpose toward which these instruments are 

directed in this study is group comparison. All instruments in this section 

■were given by school psychologists in small group situations. 

Student S urvey . The student survey was described in chapter 4 and will 
\ " * 

I not be repeated here. For this analysis we obtained both a total score and 

f 

I the per cents of affirmative responses to each item. Since the results obtained 

from the suburban sample were reported in chapter 4, they also -will not be 

reported. 

What I Am Like. What I Am Like is an instrument developed by the Division 



of Psychological Services and the Division of Program Development to measure 
self-concept by having pupils rate themselves on a five point, bi-polar adjec- 
tive scale. This technique is based on Osgood’s concept of the semantic 
diff^srential. 

The instr'ument consists of three subtests of ten items each. The first 
subtest, ’What I Look Like, consists of adjectives characterizing physical 
attributes. The second. What I Am, attempts to measure self-image from a 
psychological point of "view. The third. What I Am Like When I am With ffy 

Friends, concerns social attributes. 

I 

I For each item on What I Am Like a score of five represents the positive 

I 

I pole of the trait, and a score of one the negative pole. A rating of three 
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may be viewed as neutral. In a few cases it was difficult to assign positive 
and negative polarity. On the instrument itself the position of positive and 
negative poles was randomized to avoid a psychological set in rating the items. 

A total score was derived on each pupil in the sample groups as well as 
the suburban sample. In addition, each of the three subtests was scored. The 
instrument was given in grades 4, 6, 7> and 10. 

Attitudes Toward Self and School . The Attitudes Toward Self and School or 
"Faces" test consists of l8 items, each having two circles drawn to represent a 
smiling or frowning face. The pupil is asked to blacken the nose of the picture 
that describes how he feels when the examiner reads a particular statement. For 
example, "How do you feel about how well you read?" and "How do you feel when you 
get your report card and take it home?" were two of the l8 items. It was assumed 
that if a pupil marked the smiling face this indicated a positive attitude toward 
whatever was being measured. On the other hand, if he marked the frowning face, 
this was assumed to mean that his feelings were more negative. 

Although the items were selected on the basis of previous research in 
motivation and self-concept, no validity or reliability evidence is available 
for the "Faces" instrument. A total score was derived for the instrument and 
the responses to individual items were examined for information about self- 
concept and school motivation. The instrument was given only in grade 2. 

Hous e- Tr e e -Per s on . The House-Tree-Person test is a projective technique 
in which pupils draw these three commonly experienced objects. The technique 
assumes that children (and others) express their drives, needs and interpersonal 
experiences in the drawings they make. A re^/iew of several studies relating 
self-concept to children’s drawings revealed 18 possible hypotheses, eight of 
which seemed to have the support of experimental evidence and clinical cross- 
validation by more than one author. Pupil drawings were scored for the following 



eight factors. 



1« Size of the first person drawn. Eesearch indicates that a person’s 
self evaluation affects the way he draws the human figure and that 
largest figures are drawn by children with more positive self evalu- 
ation. 

2. Degree of discrepancy of first person from the vertical position. 
Hammer concludes that the self-image can be projected in the person 
drawing. A toppling figure reflects the subject's concern about, 

3. Detailing in drawings. Hammer describes this as an index of feelings 
of adetjuacy. He states that changes in a child's self perceptions 
can be noted through changes in various details from one drawing to 
another. 

4. Detailing of face in the first person drawn. This is an extension 
of number 3» It is important in that self-concept is focused in 
the head and the face of the person drawing. 

5 . Position of drawn wholes on the pages. Children who center their 
work on the paper tend to be more self -directed and secure. 

6. Degrading of drawings. This occurs when the child feels his 
experiences have beaten him and left him emotionally crippled. 

7 . Sex of the person drawn first. Sex identification is related to 
self-concept. Most people draw their own sex first. 

8. Distortion of drawings. Drawings are the product of experience. 

The effects of experience will modify the detailing, proportion 
and perspective produced. 

A scoring system was developed to measure the degree of presence of each 
factor. Each factor was scored on a three -point scale making the maximum 
score 24; i.e., eight factors times three points each. Since this scoring 
system is unique, no norms are available. 

Methods of Analysis 

Analysis focused on whether or not significant differences were evident 
among the five sample groups. Data is available for these instrments only 
for 1967 since they were taken anonymously in I966. Thus, for total scores 
and other continuous data, analysis of variance was applied. Dichotomous 
responses, usually to specific items, were analyzed with chi square. 

Results 

Student Survey . The per cents of affirmative responses to each survey 
item and sample group of children are summarized in table 23. Mean total 
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Trnbl# 23 # Percents of Afflrroatlvc Response for I 4 ay 1967 Student :>\ir-/ey Item for the PUPIL SAI-!ri£ Groups by Grade. 



ITEM 



1. Do you like school? 

2. Do you need more help from your teacher? 

3. Do you read books from a library? 

4. Do you like your school? 

5. Do you enjoy field trips? 

6. Do field trips help you In schoolworU? 

7« Do you get along better outside of school than 
In school? 

8. Would you like to spend more time at school? 

9. Arc you satisfied with the grades on your 

report card? 

10. Do you worry about your schoolwork? 

11. Arc you doing better In your schoolvrork this 

year? 

12. Do YOU look forward to coming to school each 

morning? 

13. Do you talk about school at home? 

14. Has someone from home ever talked to your 

teachers? 

15« Do you get praise at home for good schoolvrork? 

16 • Do you think you will graduate from high school? 

17. Do you hope to go to college? 

18. Do you talk at home about what kind of Job or 

career you will have after you are out of school 

19. Do you read more than Is required hy your 

schoolwork? 

20. Do you think your teachers usually expect too 

much of you? 

21. Do your teachers think you are do*ng well In 

your schoolwork? 

22. Do your parents think you are doing well In 

your schoolwork? 

23# Do you think you could do well in any school 
subject If you studied hard enough? 

24. Are your lowest grades usually your teacher’s 

fault? 

25. Do you think you could do well In any kind of 

job you choose? 
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scores for each group also are reported. Total score was obtained only from 20 
of the 25 items. Items 2, 9, 10, 23j and 25 were not included in total score 
"because the "right" response could be interpreted as either yes or no 
depending on your viewpoint. Of the 20 items scored, "yes" was the "right" 
response on all except items 6, 20, and 2k where "no" was the "right" response. 

Comparison of HSPT and ISPT shows little difference in item response except 
for a few items in grade 10. HSPT tenth graders believe they are doing better 
in their school work and look forward to coming to school each morning more than 
ISPT while more of the latter hope to go to college. Comparison of HSST and ISST 
shows practically no difference either, except some indication that ISST pupils 
need more nelp from their teachers. Several of the NSC item responses were 
different from the other groups but usually such differences can be explained 
by the similarity of NSC with suburban responses reported in tables 7 and 8. 

Analysis of total score showed a significant difference at grade 2 with 
ISPT HSPT=NSC. No significant difference was observed at any other grade level. 

In view of the great number of comparisons made, the few that appear signi- 
ficant may indeed be a matter of chance. In general, there are no discernable 
differences among sample groups on the student survey. 

What 1 M Like . A summary of subtest and total score means for this 
instrument is shown in table 2k. The N's are not shown oecause they are similar 
to those shown in table 21. A maximum subtest score of 50 is possible, this 
being obtained by the pupil rating himself on the positive pole of each of the 
ten pairs of bi-polar adjectives. With three subtests, the total possible 
score on the instrument is I50. 

By merely glancing across rows, we observe little difference in means in 
grades 4 and 6. Standard errors of subtest meauis range from .58 to I.I9 while 
those of total test score range from 1.46 to 2.36. Thus, it is apparent that 
no significant difference exists in any means in grades 4 and 6. 



o 



io4 



Table 24. Subtest 
SAMPLE, 


and Total Score Means of 
and Suburban Groups. 


What I Am 


Like by Grade, 


PUPIL 


Grade 














Subtest 


HSPT 


LSPT 


HSST 


LSST 


NSC 


Suburban 


GRADE 4 














Physical 


38.38 


38.76 


39.69 


38.66 


38.13 


39.34 


Psychological 


38.93 


-.A 

jjo.oy 






0^.0^ 




Social 


37.11 


38.14 


39.77 


37.38 


38.03 


37.58 


Total 


114.41 


115.59 


115.75 


114.89 


115.83 


116.01 


GRADE 6 














Physical 


39.12 


38.20 


39.15 


38.53 


38.42 


39.33 


Psychological 


38.83 


38.71 


38.45 


38.17 


38.66 


38.93 


Social 


37.31 


37.62 


37.35 


38.28 


37.44 


38.54 


Total 


115.17 


114.53 


115.09 


115.04 


114.52 


116.80 


GRADE 7 










, • 


• 


Physical 


37.65 


39.14 






37.16 


39.19 


Psychological 


36.53 


37.59 






36.66 


38.08 


Social 


36.07 


36.77 






36.82 


37.60 


Total 


110.25 


113.50 






110.64 


114.87 


GRADE 10 














Physical 


40.15 


37.83 






* 




Psychological 


39.18 


37.06 










Social 


38.07 


37.96 










Total 


117.39 


112.85 











*Measiires for tenth grade suburban pupils were not obtained. 



Total score means in grades 7 and 10 do show larger differences among groups 
but they are not consistent. In grade 7, LSPTMiSPT while in grade 10 the reverse 
is true. In grade 7, the differences do not quite reach significance while in 
grade 10 the difference was significant. 

Comparison of the total score suburban means to sample group means shows 
that at each grade level tested, 4, 6, and 7, the suburban means are higher than 
those of sample groups. The differences are small and not statistically signi- 
ficant but they are consistently higher. Thus, there is a hint, at least, that 
se3,f~concept of suburban children may be higher than that of target children as 
measured by this instrument. 

In general, analysis of What I M Like shows no sample group difference of 
any consequence to support the hypothesis that pupil self-concept will get better 
with ESEA services. 
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Attitudes Tovrard Self and School , This instrument , called the **Faces ’* 
test was given only in grade 2 as a substitute measure for What I M Like 
which was not appropriate for second graders. A summary of these test 
results is shown in table 25. 

Table 25. Percents of nviil^iT’Bn Mflr*irincr ’’qw? T-?v>rr** oAumTTn n 

- -o x«->i u/^i’irjuu ux'uujjS aHU 

Suburban Children in Grade Two. 



Items 



HSPT 

(N=109) 



ISPT NSC 

(M=92) (11=99) 



Suburban 

(N=306) 



1 . 

2 . 

3 . 

4. 

5. 

6 . 

7. 

8 . 

9 . 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

18 . 



How do you feel about growing up and 
getting older? 

How do you feel when it’s time to get 
up and go to school? 

How do you feel when you have a chance 
to learn something? 

How do you feel when you think about 
going home after school each day? 

How do you feel when your teacher tells 



How do you feel when you think about how 
fast you learn? 

How do you feel 
she is going to 
How do you feel 
strong you are? 

How do you feel 
How do you feel 
neighbors treat 



when your teacher says 

give a test? 

about how healthy and 



about the way the 
you? 



How do you feel about how you look and 
the kind of face you have? 

How do you feel about the way other 
children treat you? 

How do you feel when you get your report 
card and take it home? 

How do you feel about how much you know? 
How do you feel about how well you do 
arithmetic? 

How do you feel when you think about 
next year in school? 

How do you feel about the way your 
teacher treats you? 

How do you feel when your teacher says 
it's your turn to read out loud? 



82 


80 


72 


79 


58 


64 


46 


54 


94 


96 


94 


67 


71 


82 


67 


81 


57 


67 


62 


58 


91 


92 


90 


95 


66 


76 


58 


54 


95 


96 


99 


98 


91 


96 


93 


94 


64 


66 


51 


71 


79 


83 


86 


86 


48 


46 


4l 


68 


80 


80 


73 


78 


93 


97 


95 


95 


83 


88 


P," 


85 


59 


66 


43 


66 


69 


68 


62 


81 


84 


89 


87 


85 



TOTAL SCORE AVERAGE)^ 

*Mean number of smiling faces markedT 



13.98 iit.30 13.39 13.96 
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Consistent with results of previous self-concept measures we find no 
significant differences in total score either among sample groups or suburban 
children. The four means reported range from 13*39 bo l4.30. Inspection of 
item statistics in table 25 also show no significant difference in general 
but a few items show differentiation. Items 3 and 7 show that significantly 
fewer suburban children "smile" when they "have a chance to learn something" 
or when "the teacher says she is going to give a test." This finding is 
consistent with those of the student survey reported in chapter 4 which 
showed more anxiety among suburban children with respect to school work. 

Suburban children, however, "smile" more fi*equently than sample children 
on items 12 (the way other children treat you) and item 17 (the way the teacher 
treats you). Response to these two items; i.e., 12 and 17, last year by a 
random sample of PT and ST children showed results which parallel the responses 
of this suburban group. Thus, the difference is not between suburban and 
target school children, but rather between the sample groups and others in 
the same schools as well as suburban schools. This finding may be of great 
importance in understanding why these children achieve poorly in relation to 
their peers. 

House-Tree-Person . The H-T-P was given to all sample groups as well as 
the suburban saLiple. The results are summarized in table 26. Grade differences 
in mean H-T-P score are apparent showing older children scoring higher. Ability 
to draw apparently has some influence on scoring although attempts were made to 
minimize this influence. Within grades, however, there should be no group 
comparison bias. Those who studied the results of H-T-P given last year* to 
random samples of PT and ST pupils will recognize that the means shown in 
table 26 are higher but that grade differences are lower. We changed scoring 



*Journal of Instructional Research and Program Development , Volume 2, Number 1, 
October, 1966, Cincinnati Public Schools, pg, 62. 
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procedures somewhat to reduce the effects of age on score. 

Table 26. Mean House-Tree-Person Scores for the PUPIL SAMPLE and Suburban Groups 
by Grade*. 



Grade 


HSPT 


ISPT 


HSST 


ISST 


NSC 


Suburban 


2 


17.22 


17.26 






17.26 


18.00 


4 


18.08 


18.63 


18.28 


18.13 


18.02 


19.45 


6 


18.65 


19.59 


19.38 


19.65 


19.22 


20.04 


7 


19.31 


19.39 


- 


- 


19.20 


20.12 


10 


19.62 


19.96 


• 


•• 




— 



*N's are similar to those shown in table 23. 



Inspection of group means reveals a pattern similar to that of What I M Like . 
Analysis showed no significant difference among sample groups at any grade level. 
We observe again, however, that suburban means are consistently higher at all 
grade levels measured. The differences are not great but their significance 
must be measured by their frequency of occurrance and consistency with other 
instruments . 

Discussion 

This chapter has attempted to compare pupil sample groups and the suburban 
sample on measui*es thought to reflect attitudes and self-concept. The complexity 
of subtlety of what is being measured must be borne in mind in interpreting 
results. Statistical significance alone is an insufficient criterion. One 
must look at pattern and consistency. 

Using these criteria there is no evidence of consequence to suggest that 
ESEA treatment intensity is bettering the attitudes or the self-concept of 
children. There is sufficient consistency to believe that suburban children 
have a better self-concept. 

If one is prone to accept increasing similarity of target to suburban 
children performance and attitude as a criterion of the success of ESEA, some 
caution or reflection is appropriate. Are we seeking more anxiety and lower 
school valence among target children to correspond to suburban children? 
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Dependency upon the school environment to meet the needs of children must be 
judged in relation to the child’s total environment. That which the home 
cannot provide must be provided by the school if the school’s major goal of 
academic achievement is to be reached. 




X 
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CHAPTER 15 

PROMOTION, ATTENDANCE AND DROP-OUT 

Description 

The reader is referred to chapters 8, 9 j 3-nd 10 for descrip&ion of these 
criteria = These measures are reported in the same way although they were 
obtained from pupil cumulative records rather than from school reports upon 
which previous data were based. 

Methods of Analysis 

All the data in this chapter were outputs from a computer program which, 
in addition to computing means, also computed their standard errors. In 
comparing z^ore than one pair of means, the largest rrean difference w^*s tested 
and if the test was significant the next largest difference was tested, etc. 
Suburban statistics were not collected for these criteria. 

Results 

Promotion . Summary of promotion rates and differences from I966 to I967 
by grade and sample group are shown in table 27^ 

Standard errors of the means ranged from .00 to .04. The largest difference 
in the table is shown in grade 2 HSPT where promotion was 99f> in I966 while only 
89^ in 1967* This represents a significant reduction in promotion. The remain- 
ing three significant differences are also decreases; grades 7 and 10 in ISPT 
and grade 7 for NSC. All 1966, 196'r differences for HSPT are decreases. In 
fact, of 18 differences reported, 13 are decreases, 2 show no difference, and 
only 3 are increases. Further interpretation is not productive. The fact is 
that neither HSPT>ISPT nor is HSST>ISST. ESEA services have not increased 
promotion rates. 

Attendance . The criterion statist! 3 is expressed as days of average daily 
absence rather than attendance. Table 28 summarizes the attendance data. The 




pa-^ tern, similar to promotion, is generally undesirable. Of the I8 differences 
reported, only 2 show a decrease in average daily absence while I6 show increases. 






• • * ^ ii gr^H »< W^ WSIi5>li 
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The three statistically significant increases in absence are all at the 
seventh grade level in HSPT, ISPT, and NSC. High absence seems characteristic 
of the jiinior high school years. 

r\o4*4*o*»*n •? o'HcsA'n/^o o*K oil crT»Q/1ia 1 A^rol c ^*V-a 

hypothesis that ESEA services will reduce absence. 

Drop-out . The only grade in which drop-out is meaningful is grade 10 
because in other grades of the sample, children are too young to leave school. 
Of the 71 HSPT tenth graders, 4 dropped out. Of the 63 ISPT tenth graders, 

3 dropped out. With such small numbers and such a small difference, little 
can be said one way or the other regarding the effects of ESEA on drop-outs. 
Discussion 

The data presented in this chapter continue the string of evidence 
revealing a lack of support of the hypothesis that ESEA will better the 
performance of target children. As compared to I966, the trend is toward 
lower promotion rates and higher average daily absence. This finding was 
true of all five sample groups, not just the high service groups. These 
characteristics are, of course, typical of low achieving, disadvantaged 



children. 








CHAPTER 16 

A CLOCER LOOK AT HIGH SERVICE 
PRIMARY TARGET CHILDREN 

The results of the three preceding chapters add up to one general finding — 
no significant difference among sample groups. This finding is contrary to 
the h;;ipothesis and our general notion of the beneficial effects of the program 
services, particularly remedial reading. Of course, the strategy of the 
SAMPLE comparisons rests on the definition of "high service." If, indeed, our 
operational definition of what constitutes the best services is incorrect, 
then we would not expect differences among the five sample groups and our 
general hypothesis would have no rational basis. 

In an effort to test out the validity of "high service” definition we 
singled out the fSPT group and subdivided then into four ESEA intensity groups. 
Obviously, all had "high service" as defined, but we were interested in further 
subdivision to see if higb*^r intensity of treatment produced higher criterion 
measures. Unfortimately, the number of cases per grade in IKPT and per intensity 
group was too small so we combined the two higher and the two lower groups for 
comparison. Such comparison was possible only in grades 2, 4, and 6. In grades 
7 and 10 there were no pupils who met the definition of the lower group. In 
other words, all HSPT pupils in grades 7 and 10 had at least 2k hours of remedi- 
ation which was the cut-off point between high and low intensity groups. 

Comparison of high and low intensity groups in grades 2, 4, and 6 led to 
inconsistent results. In grade 2, all five achievement subtest gains were 
higher for the high intensity group but the largest difference (in the reading 
subtests) was only 2 months. In grade 4, three subtest gain comparisons favored 
the low intensity group and one (arithmetic concepts) favored the high intensity 
group. In grade 6, six of seven subtest gains were higher for the lower inten- 
sity group. 

In a simi'^ar vein, all other criterion measures showed inconsistent results 
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thus leading to some serious questions relative to the appropriateness and/or 
effectiveness of the treatments. It is possible, however, that some unknown 
bias is operating to cloud the effects. 
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CHAPTER 17 

CONCLUDING STATEMENTS 

In viewing the findings of this report, the general pattern is that of 
no significant difference. From the inception of the Education Act, educators 
nationally have given consistent warnings not to expect changes to occur within 
the first few years of operation. No one could predict how much or what kind 
of change would occur or over what period of time. It simply seemed to be a 
fair bet, that on the basis of previous experience in educating disadvantaged 
children, that significant and far-reaching effects simply would not take place 
within a few years. In spite of our acceptance of this notion, one cannot help 
to feel some uneasiness over the lack of some effects small as they may be. 
Reaction to the findings of this evaluation report cannot be one of despair. 
Instead, it must serve as a stimulant to educators to continue attempts to 
find out what services do produce the kinds of effects which were anticipated. 
Further, one should be reminded that this report concerns itself only with 
program, not project, evaluation. Individual projects, to be reported in 
succeeding issues of the JOURNAL, may show achievement of specific goals not 
reflected in this report. In asking why the general hypothesis was usually 
rejected, one may hypothesize that gains will not show up in any consistent 
way until after several years of continuous treatment on the same set of pupils. 
A second hypothesis is that the types of treatments and/or their effectiveness 
are not as good as they should be. Third, one may speculate that our methods 
of evaluation are not valid in detecting changes that may have occurred. The 
fact that HSPT is a selected and therefore unmatchable group cannot be over- 
emphasized. It mitigates against unbiased comparison and the use of experimen- 
tal research designs. 

Based on what we have learned from this investigation, where do we go 
from here? There are several impressions which may be viewed as guideposts 
for the futTire ESEA pi'ogram. 
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Most ESEA resources will continue to be focused on primary target 
schools. HSPT pupils will continue to receive high service and 
even further attempts to increase treatment intensity will be 
made. Secondary target schools will continue to receive a minimum 
of ESEA service. Pupils in ST schools will serve as comparison 
foi* H 6 xt- s pvo 1 ijo+.i r>n . 
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It is possible that the ESEA program as a whole places too much 
stress on increased academic types of treatments. Perhaps, for 
example, greater stress needs to be placed on the inspirational 
approach rather than attacking the problem head-on through re- 
mediation. This would suggest greater stress on parent involve- 
ment and upon inservice teacher training which would be aimed 
at helping teachers bring out the best in the children they 
serve. 
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Since we are essentially in the dark as to what really works, we 
will attempt, early this fall, to identify those pupils in the 
sample who have shown the highest achievement gain. Through a 
case study approach we will work backwards to find out what the 
characteristics of these children are and what particular set of 
services, if any, were in common to this higher achieving group. 

Such a study may provide some clues as to program emphasis and 
direction this year. 

Since the general hypothesis of more service yielding more achieve- 
ment or better criterion measures was rejected at least for the 
present we are led increasingly to believe that if something is to 
be done of a significant nature to disadvantaged children it must 
be done at the earliest age possible. Thus, to whatever extent 
possible the highest degree of service and resources will be directed 
in the primary grades particularly with children served throu^ the 
preschool program. 

The correlates to pupil achievement need to be studied intensively 
to obtain clues as to how pupil achievement can be increased. 
Correlation analysis of the data obtained in the pupil sample will 
be made in an attempt to discover whether or not certain pupil 
characteristics are linked together in defining a low versus a 
high achieving pupil. 




